Nov 28 06:31:50 user devstack@n-api.service[64870]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 28 06:31:50 user devstack@n-api.service[64870]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Nov 28 06:31:50 2023] *** Nov 28 06:31:50 user devstack@n-api.service[64870]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Nov 28 06:31:50 user devstack@n-api.service[64870]: os: Linux-5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 Nov 28 06:31:50 user devstack@n-api.service[64870]: nodename: user Nov 28 06:31:50 user devstack@n-api.service[64870]: machine: x86_64 Nov 28 06:31:50 user devstack@n-api.service[64870]: clock source: unix Nov 28 06:31:50 user devstack@n-api.service[64870]: pcre jit disabled Nov 28 06:31:50 user devstack@n-api.service[64870]: detected number of CPU cores: 12 Nov 28 06:31:50 user devstack@n-api.service[64870]: current working directory: / Nov 28 06:31:50 user devstack@n-api.service[64870]: detected binary path: /usr/bin/uwsgi-core Nov 28 06:31:50 user devstack@n-api.service[64870]: your processes number limit is 63589 Nov 28 06:31:50 user devstack@n-api.service[64870]: your memory page size is 4096 bytes Nov 28 06:31:50 user devstack@n-api.service[64870]: detected max file descriptor number: 2048 Nov 28 06:31:50 user devstack@n-api.service[64870]: lock engine: pthread robust mutexes Nov 28 06:31:50 user devstack@n-api.service[64870]: thunder lock: enabled Nov 28 06:31:50 user devstack@n-api.service[64870]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 28 06:31:50 user devstack@n-api.service[64870]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] Nov 28 06:31:50 user devstack@n-api.service[64870]: PEP 405 virtualenv detected: /opt/stack/data/venv Nov 28 06:31:50 user devstack@n-api.service[64870]: Set PythonHome to /opt/stack/data/venv Nov 28 06:31:50 user devstack@n-api.service[64870]: Python main interpreter initialized at 0x55e8e2cf4b90 Nov 28 06:31:50 user devstack@n-api.service[64870]: python threads support enabled Nov 28 06:31:50 user devstack@n-api.service[64870]: your server socket listen backlog is limited to 100 connections Nov 28 06:31:50 user devstack@n-api.service[64870]: your mercy for graceful operations on workers is 80 seconds Nov 28 06:31:50 user devstack@n-api.service[64870]: mapped 537436 bytes (524 KB) for 3 cores Nov 28 06:31:50 user devstack@n-api.service[64870]: *** Operational MODE: preforking *** Nov 28 06:31:50 user devstack@n-api.service[64870]: *** uWSGI is running in multiple interpreter mode *** Nov 28 06:31:50 user devstack@n-api.service[64870]: spawned uWSGI master process (pid: 64870) Nov 28 06:31:50 user devstack@n-api.service[64870]: spawned uWSGI worker 1 (pid: 64871, cores: 1) Nov 28 06:31:50 user devstack@n-api.service[64870]: spawned uWSGI worker 2 (pid: 64872, cores: 1) Nov 28 06:31:50 user devstack@n-api.service[64870]: spawned uWSGI worker 3 (pid: 64873, cores: 1) Nov 28 06:31:50 user devstack@n-api.service[64870]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 06:31:54 user devstack@n-api.service[64871]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 06:31:54 user devstack@n-api.service[64871]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 06:31:54 user devstack@n-api.service[64871]: and ``live_migration_inbound_addr`` respectively. Nov 28 06:31:54 user devstack@n-api.service[64871]: ). Its value may be silently ignored in the future. Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 06:31:54 user devstack@n-api.service[64873]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 06:31:54 user devstack@n-api.service[64873]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 06:31:54 user devstack@n-api.service[64873]: and ``live_migration_inbound_addr`` respectively. Nov 28 06:31:54 user devstack@n-api.service[64873]: ). Its value may be silently ignored in the future. Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 06:31:54 user devstack@n-api.service[64872]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 06:31:54 user devstack@n-api.service[64872]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 06:31:54 user devstack@n-api.service[64872]: and ``live_migration_inbound_addr`` respectively. Nov 28 06:31:54 user devstack@n-api.service[64872]: ). Its value may be silently ignored in the future. Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64871) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64873) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 06:31:54 user devstack@n-api.service[64871]: INFO dbcounter [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Registered counter for database nova_api Nov 28 06:31:54 user devstack@n-api.service[64873]: INFO dbcounter [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Registered counter for database nova_api Nov 28 06:31:54 user devstack@n-api.service[64872]: INFO dbcounter [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Registered counter for database nova_api Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG oslo_db.sqlalchemy.engines [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writer thread running {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG oslo_db.sqlalchemy.engines [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64873) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG oslo_db.sqlalchemy.engines [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writer thread running {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writer thread running {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG nova.context [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27e7b418-6c10-4d08-8a14-ffd74894eb19(cell1) {{(pid=64871) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:31:54 user devstack@n-api.service[64871]: INFO dbcounter [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Registered counter for database nova_cell0 Nov 28 06:31:54 user devstack@n-api.service[64871]: INFO dbcounter [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Registered counter for database nova_cell1 Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG nova.context [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27e7b418-6c10-4d08-8a14-ffd74894eb19(cell1) {{(pid=64873) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG nova.context [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27e7b418-6c10-4d08-8a14-ffd74894eb19(cell1) {{(pid=64872) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG oslo_db.sqlalchemy.engines [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64873]: INFO dbcounter [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Registered counter for database nova_cell0 Nov 28 06:31:54 user devstack@n-api.service[64872]: INFO dbcounter [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Registered counter for database nova_cell0 Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writer thread running {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG oslo_db.sqlalchemy.engines [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64873]: INFO dbcounter [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Registered counter for database nova_cell1 Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG oslo_db.sqlalchemy.engines [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64873) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writer thread running {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG oslo_db.sqlalchemy.engines [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64873) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64872]: INFO dbcounter [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Registered counter for database nova_cell1 Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG oslo_db.sqlalchemy.engines [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writer thread running {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG oslo_db.sqlalchemy.engines [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writer thread running {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:54 user devstack@n-api.service[64871]: INFO dbcounter [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Registered counter for database nova_cell0 Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writer thread running {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG oslo_db.sqlalchemy.engines [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64873]: INFO dbcounter [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Registered counter for database nova_cell0 Nov 28 06:31:54 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writer thread running {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG oslo_db.sqlalchemy.engines [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64873) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:54 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writer thread running {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writer thread running {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:55 user devstack@n-api.service[64872]: INFO dbcounter [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Registered counter for database nova_cell0 Nov 28 06:31:55 user devstack@n-api.service[64872]: DEBUG oslo_db.sqlalchemy.engines [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 06:31:55 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writer thread running {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 06:31:55 user devstack@n-api.service[64871]: WARNING keystonemiddleware.auth_token [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 06:31:55 user devstack@n-api.service[64871]: WARNING keystonemiddleware.auth_token [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 06:31:55 user devstack@n-api.service[64873]: WARNING keystonemiddleware.auth_token [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 06:31:55 user devstack@n-api.service[64873]: WARNING keystonemiddleware.auth_token [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 06:31:55 user devstack@n-api.service[64872]: WARNING keystonemiddleware.auth_token [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 06:31:55 user devstack@n-api.service[64872]: WARNING keystonemiddleware.auth_token [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 06:31:55 user devstack@n-api.service[64871]: WARNING keystonemiddleware.auth_token [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 06:31:55 user devstack@n-api.service[64871]: WARNING keystonemiddleware.auth_token [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 06:31:55 user devstack@n-api.service[64873]: WARNING keystonemiddleware.auth_token [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 06:31:55 user devstack@n-api.service[64871]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e8e2cf4b90 pid: 64871 (default app) Nov 28 06:31:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:31:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001552 Nov 28 06:31:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Nov 28 06:31:55 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:31:55 user devstack@n-api.service[64873]: WARNING keystonemiddleware.auth_token [None req-7a2f99ec-dcd8-44ad-ae8e-007f3f07cdb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 06:31:55 user devstack@n-api.service[64873]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e8e2cf4b90 pid: 64873 (default app) Nov 28 06:31:55 user devstack@n-api.service[64872]: WARNING keystonemiddleware.auth_token [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 06:31:55 user devstack@n-api.service[64872]: WARNING keystonemiddleware.auth_token [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 06:31:55 user devstack@n-api.service[64872]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e8e2cf4b90 pid: 64872 (default app) Nov 28 06:34:06 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-1d58b1fb-358b-41b4-a4c3-f7b2139045bf None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001525 Nov 28 06:34:06 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:06 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:06 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:06 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:06 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:06 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0e95438d-2e85-4221-810f-0689499ff0fb admin admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:06 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0e95438d-2e85-4221-810f-0689499ff0fb admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.393603 Nov 28 06:34:06 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 28 06:34:06 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:34:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002797 Nov 28 06:34:08 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:08 2023] GET /compute/v2.1 => generated 387 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:08 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:08 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:08 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:08 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:08 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c293296e-ad84-402d-9981-7f39b09a4107 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:08 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c293296e-ad84-402d-9981-7f39b09a4107 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.325753 Nov 28 06:34:08 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 06:34:08 2023] POST /compute/v2.1/flavors => generated 405 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:34:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ce07a79b-d0c6-45f7-9aa8-20f1d3643766 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-ce07a79b-d0c6-45f7-9aa8-20f1d3643766 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043130 Nov 28 06:34:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 06:34:08 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:34:10 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001544 Nov 28 06:34:10 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:10 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9d66d87c-64ec-4928-9ac5-65f788f5c093 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:10 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9d66d87c-64ec-4928-9ac5-65f788f5c093 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081528 Nov 28 06:34:10 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 06:34:10 2023] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:34:10 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8119b53b-37c0-4869-86d3-370ce4044e99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:10 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-8119b53b-37c0-4869-86d3-370ce4044e99 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024620 Nov 28 06:34:10 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 06:34:10 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:34:12 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:12 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001405 Nov 28 06:34:12 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:12 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e48be776-20d2-48b3-8625-60cf492492d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:12 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e48be776-20d2-48b3-8625-60cf492492d1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069921 Nov 28 06:34:12 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 06:34:12 2023] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:34:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-4702354c-a815-4afd-afb7-dba45fd257c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-4702354c-a815-4afd-afb7-dba45fd257c3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025554 Nov 28 06:34:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 06:34:12 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:34:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001503 Nov 28 06:34:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:14 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:14 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-69b922bd-466e-468c-a592-05910fc708a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 10}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-69b922bd-466e-468c-a592-05910fc708a7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.095770 Nov 28 06:34:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 06:34:14 2023] POST /compute/v2.1/flavors => generated 402 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:34:15 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-19730d39-2177-4d5e-834e-9729dc731b68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:15 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-19730d39-2177-4d5e-834e-9729dc731b68 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023100 Nov 28 06:34:15 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 06:34:15 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:34:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:17 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003510 Nov 28 06:34:17 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:17 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-cebdf32f-3bed-40f6-98a2-0a995555fbc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-cebdf32f-3bed-40f6-98a2-0a995555fbc0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068027 Nov 28 06:34:17 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 06:34:17 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:34:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024832 Nov 28 06:34:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 06:34:17 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:34:19 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:19 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-506e09c0-a8f2-4bf0-86e5-ab0a7dd396db None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001424 Nov 28 06:34:19 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:19 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:19 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9904f660-285a-4aad-bd06-582527335717 admin admin] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:19 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9904f660-285a-4aad-bd06-582527335717 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.075009 Nov 28 06:34:19 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 28 06:34:19 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:34:21 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:21 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001416 Nov 28 06:34:21 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:34:21 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-135e3ed2-0664-4555-a9d1-099430f309fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "ram": 512}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-135e3ed2-0664-4555-a9d1-099430f309fa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.363900 Nov 28 06:34:21 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 06:34:21 2023] POST /compute/v2.1/flavors => generated 400 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:34:21 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-beb034d7-73d6-4b1f-b256-df33b7f282a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-beb034d7-73d6-4b1f-b256-df33b7f282a9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034606 Nov 28 06:34:21 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 06:34:21 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:34:23 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001307 Nov 28 06:34:23 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:23 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:23 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-291140c5-5617-4206-bca0-0b9667152701 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "disk": 20, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:23 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-291140c5-5617-4206-bca0-0b9667152701 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.071803 Nov 28 06:34:23 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 06:34:23 2023] POST /compute/v2.1/flavors => generated 403 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:34:23 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-50236317-3637-4257-bac3-98dd517ea16f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-50236317-3637-4257-bac3-98dd517ea16f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026234 Nov 28 06:34:23 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 06:34:23 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:34:25 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001289 Nov 28 06:34:25 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:25 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:25 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-34eca3ea-9160-4fcf-ad79-8194e2a65dc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:25 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-34eca3ea-9160-4fcf-ad79-8194e2a65dc6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063129 Nov 28 06:34:25 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 06:34:25 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:34:25 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5221a760-3a2f-486a-b390-7d659f696ae4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:25 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5221a760-3a2f-486a-b390-7d659f696ae4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029664 Nov 28 06:34:25 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 06:34:25 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:34:27 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001390 Nov 28 06:34:27 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-dfe3a528-8ca0-4031-b1d1-ccae6f5e2df1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "id": "4"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-dfe3a528-8ca0-4031-b1d1-ccae6f5e2df1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.071457 Nov 28 06:34:27 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 06:34:27 2023] POST /compute/v2.1/flavors => generated 403 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:34:27 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-fa427045-264d-431d-b0b0-91efae050152 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-fa427045-264d-431d-b0b0-91efae050152 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026617 Nov 28 06:34:27 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 06:34:27 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:34:30 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:34:30 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001335 Nov 28 06:34:30 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 06:34:30 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:34:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-37630e98-ab4e-403f-b00d-77cfa9bfe827 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-37630e98-ab4e-403f-b00d-77cfa9bfe827 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.062549 Nov 28 06:34:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 06:34:30 2023] POST /compute/v2.1/flavors => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:34:30 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a7575fa2-0564-4c9f-b95c-5950b4e15135 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:34:30 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a7575fa2-0564-4c9f-b95c-5950b4e15135 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030769 Nov 28 06:34:30 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 06:34:30 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:35:02 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:35:02 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-24dea775-2863-4b3c-84f8-4ba37caaa69e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001629 Nov 28 06:35:02 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 06:35:02 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:35:02 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:35:02 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a2d1a64e-09ad-4898-8a26-901a2a882015 admin admin] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:35:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a2d1a64e-09ad-4898-8a26-901a2a882015 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:35:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a2d1a64e-09ad-4898-8a26-901a2a882015 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:35:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a2d1a64e-09ad-4898-8a26-901a2a882015 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:35:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a2d1a64e-09ad-4898-8a26-901a2a882015 admin admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:35:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a2d1a64e-09ad-4898-8a26-901a2a882015 admin admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:35:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a2d1a64e-09ad-4898-8a26-901a2a882015 admin admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:35:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a2d1a64e-09ad-4898-8a26-901a2a882015 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.095410 Nov 28 06:35:02 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1389 bytes} [Tue Nov 28 06:35:02 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:35:32 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a7575fa2-0564-4c9f-b95c-5950b4e15135 admin admin] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:35:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a7575fa2-0564-4c9f-b95c-5950b4e15135 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002623 Nov 28 06:35:32 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 06:35:32 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:35:32 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:35:32 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e0a7e998-c1be-463d-9968-e5f553f2545f admin admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:35:32 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e0a7e998-c1be-463d-9968-e5f553f2545f admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.069593 Nov 28 06:35:32 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1368 bytes} [Tue Nov 28 06:35:32 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:35:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a2d1a64e-09ad-4898-8a26-901a2a882015 admin admin] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:35:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a2d1a64e-09ad-4898-8a26-901a2a882015 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001687 Nov 28 06:35:35 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 06:35:35 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:35:35 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:35:35 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ae460006-97cb-4cbe-a56d-61c7496a1112 admin admin] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:35:35 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ae460006-97cb-4cbe-a56d-61c7496a1112 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 424 microversion: 2.61 time: 0.062282 Nov 28 06:35:35 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 15/41] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 28 06:35:35 2023] GET /compute/v2.1/flavors/1 => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:35:37 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e0a7e998-c1be-463d-9968-e5f553f2545f admin admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:35:37 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e0a7e998-c1be-463d-9968-e5f553f2545f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002310 Nov 28 06:35:37 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 14/42] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 06:35:37 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:35:37 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:35:37 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:35:37 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:35:37 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5dcb9e1f-12c9-49c7-bb90-175a88b1eda2 admin admin] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:35:37 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-5dcb9e1f-12c9-49c7-bb90-175a88b1eda2 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/2" status: 200 len: 427 microversion: 2.61 time: 0.075830 Nov 28 06:35:37 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 14/43] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 28 06:35:37 2023] GET /compute/v2.1/flavors/2 => generated 427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:38:07 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:08 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-863344240", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:08 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] validate_networks() for [('74dfaac2-1093-4fe2-8322-f49e14500d58', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting quotas for project 8f90603ba77644568ec6f6fd37689a08. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting quotas for user 109001cce8ec4aa0b87f271b415cd5e6 and project 8f90603ba77644568ec6f6fd37689a08. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:38:09 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:38:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f9782d8b-df7a-4fe9-9e76-d4c41301d132 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.906499 Nov 28 06:38:09 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 16/44] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:38:07 2023] POST /compute/v2.1/servers => generated 381 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:38:09 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0a1ce162-1466-450e-abc9-04b6151f7b25 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:38:09 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-0a1ce162-1466-450e-abc9-04b6151f7b25 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:38:09 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:10 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0a1ce162-1466-450e-abc9-04b6151f7b25 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:10 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0a1ce162-1466-450e-abc9-04b6151f7b25 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1" status: 200 len: 1213 microversion: 2.1 time: 0.503817 Nov 28 06:38:10 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 15/45] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:38:09 2023] GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1 => generated 1213 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:38:10 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:10 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-30674904", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:10 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] validate_networks() for [('74dfaac2-1093-4fe2-8322-f49e14500d58', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:38:11 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-453551306", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:11 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-bef503f2-bad0-4308-8aa5-e2f0396e9f34 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: .version_select at 0x7f0b08c8b1c0>, body: {"keypair": {"name": "tempest-keypair-894833367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqYtsHqlq6UKTcER/k64lfbXh2pA9vJqnA4e6c2hp60qQnuBhq6XBV/hxrGLANQCI7nGeXEsElJ+UTUn1LBk09Vnw0+lDPP3HxcBU8qrbayCFVs/OVYsCYO8uUsYj85OA=="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:11 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] validate_networks() for [('25e958b1-76c6-4b10-aa2d-7792c3a7c44a', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:38:11 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-bef503f2-bad0-4308-8aa5-e2f0396e9f34 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for project 5df9ec769206481e8dad48a6461c46ba. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:11 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-bef503f2-bad0-4308-8aa5-e2f0396e9f34 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for user 05e396090c4b4a8995d8d2e66c8b3db0 and project 5df9ec769206481e8dad48a6461c46ba. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:11 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-bef503f2-bad0-4308-8aa5-e2f0396e9f34 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.424595 Nov 28 06:38:11 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 16/46] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:38:11 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting quotas for project 8f90603ba77644568ec6f6fd37689a08. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting quotas for user 109001cce8ec4aa0b87f271b415cd5e6 and project 8f90603ba77644568ec6f6fd37689a08. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:38:12 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-fe535003-79ed-490a-8853-3ef0fda3513c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.177536 Nov 28 06:38:12 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 15/47] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:38:10 2023] POST /compute/v2.1/servers => generated 381 bytes in 2194 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:38:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0829c9a0-8331-402d-97e6-b74966e2dc79 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:38:12 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-0829c9a0-8331-402d-97e6-b74966e2dc79 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:38:12 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0829c9a0-8331-402d-97e6-b74966e2dc79 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0829c9a0-8331-402d-97e6-b74966e2dc79 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7" status: 200 len: 1212 microversion: 2.1 time: 0.146020 Nov 28 06:38:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 17/48] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:38:12 2023] GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7 => generated 1212 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Getting quotas for project 6362608255de47c3afa716e3091af3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Getting quotas for user 5bd89a43a3bf4952a40cd1dd07de2442 and project 6362608255de47c3afa716e3091af3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:38:12 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:38:12 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-0696a03c-d7cd-43ca-8921-6cc0d7857445 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.776038 Nov 28 06:38:12 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 17/49] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:38:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:38:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fe5eb475-47e6-490a-8643-49594add7ee2 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:38:12 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-fe5eb475-47e6-490a-8643-49594add7ee2 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e9bd3f73-bb9c-4c4f-8990-0363d27b9115 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Action: 'create', calling method: .version_select at 0x7f0b089b5750>, body: {"keypair": {"name": "tempest-keypair-1612163949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARf+gja0GieQrZAhoqDut6qoh+Nwz1BEqnkIyGQUhGSO5PAnT+fAIgfexxoSCgBcMNGT/2MW1PKItobi/86SUc3gnzzhn7IXTvRURr6QvaAf68gQ35NhaWCN+0tna9Aw=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-e9bd3f73-bb9c-4c4f-8990-0363d27b9115 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting quotas for project 739e836995bb4af6a877468ec43d0cf3. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:12 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-e9bd3f73-bb9c-4c4f-8990-0363d27b9115 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting quotas for user 18ee95f099b64968984fd3b9e418b048 and project 739e836995bb4af6a877468ec43d0cf3. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:13 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e9bd3f73-bb9c-4c4f-8990-0363d27b9115 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.251099 Nov 28 06:38:13 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 16/50] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:38:12 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:13 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-fe5eb475-47e6-490a-8643-49594add7ee2 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:13 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-fe5eb475-47e6-490a-8643-49594add7ee2 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" status: 200 len: 1208 microversion: 2.1 time: 0.151884 Nov 28 06:38:13 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 18/51] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:38:12 2023] GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e => generated 1208 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:38:14 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1355811946", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "7bc73412-fe34-4d8c-85c8-4cc726512d5e"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:14 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] validate_networks() for [('7bc73412-fe34-4d8c-85c8-4cc726512d5e', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting quotas for project a07e9312175c4e73aa29a51865d61ebd. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting quotas for user c13b793a926942e88fc3416cf3fa005e and project a07e9312175c4e73aa29a51865d61ebd. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:38:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-886ffb27-18dd-4fe1-90c8-81bb046b1a23 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.270818 Nov 28 06:38:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 18/52] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 06:38:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 06:38:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1bbd78f1-2779-457a-b97a-9615949caf2c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:38:15 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1bbd78f1-2779-457a-b97a-9615949caf2c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:38:15 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1388737861", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "202f7756-ce64-4307-8a6b-b7601305e6b7"}], "security_groups": [{"name": "tempest-securitygroup--2147145715"}], "key_name": "tempest-keypair-894833367", "user_data": "}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:15 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1bbd78f1-2779-457a-b97a-9615949caf2c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:15 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1bbd78f1-2779-457a-b97a-9615949caf2c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:15 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1bbd78f1-2779-457a-b97a-9615949caf2c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1bbd78f1-2779-457a-b97a-9615949caf2c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62" status: 200 len: 1395 microversion: 2.87 time: 0.170842 Nov 28 06:38:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 17/53] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:38:15 2023] GET /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62 => generated 1395 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-fb4d7a39-bfe7-4123-9738-5f31779beff2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Action: 'create', calling method: .version_select at 0x7f0b089ac790>, body: {"keypair": {"name": "tempest-keypair-885228878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnK3DPwqQpIkDjZ4NsisPL5fv1fIQXgSdf/f8QHbkzAoHGgSEFC2TKF0Bj86pm0MHWIXKvUs73GL8LEDi2rEmkgnne5DxYKl2BmTV9P/AFrKBO3HZ+cZZ8zmwA3IzMdg=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-fb4d7a39-bfe7-4123-9738-5f31779beff2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting quotas for project ff4ac048770a4680a35f71465d191d49. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:15 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-fb4d7a39-bfe7-4123-9738-5f31779beff2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting quotas for user 48e7c51916684bec98970a963f2c560e and project ff4ac048770a4680a35f71465d191d49. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:15 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] validate_networks() for [('202f7756-ce64-4307-8a6b-b7601305e6b7', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:38:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-fb4d7a39-bfe7-4123-9738-5f31779beff2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.93 time: 0.392450 Nov 28 06:38:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-cd30a0c8-608b-4e2a-8a13-a347e6857b09 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Action: 'create', calling method: .version_select at 0x7f0b089b6f80>, body: {"keypair": {"name": "tempest-keypair-142163135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBFaerc1nUtKDnRM+r90VFYRGdV10VQFWDLQhuqYU/TPWJ+sUFq9W+68zFlEuxEiYAsWAKxBO79ot31nQIU3RWockau4p3vhK1K7n+Hcw0HsUre+LAFsc8TGx8g99OMQA=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 19/54] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 06:38:15 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 404 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 06:38:15 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-cd30a0c8-608b-4e2a-8a13-a347e6857b09 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Getting quotas for project b30dc21619f949b18be9362b217e7c1b. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:15 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-cd30a0c8-608b-4e2a-8a13-a347e6857b09 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Getting quotas for user 4f53e7a2f95545d196a5b2d36ef6d692 and project b30dc21619f949b18be9362b217e7c1b. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-cd30a0c8-608b-4e2a-8a13-a347e6857b09 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.082781 Nov 28 06:38:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:38:15 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:38:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherB-server-1411738955", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a"}], "security_groups": [{"name": "tempest-securitygroup--456241538"}], "key_name": "tempest-keypair-1612163949", "user_data": "}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for project 5df9ec769206481e8dad48a6461c46ba. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for user 05e396090c4b4a8995d8d2e66c8b3db0 and project 5df9ec769206481e8dad48a6461c46ba. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] Creating event network-changed:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=64872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-78e91976-193b-4a85-81bb-6c40bc46ee5e req-5ac7893f-5242-4871-a320-a1c75342cecd service nova] Acquired lock "compute-rpcapi-router" {{(pid=64872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4939e819-74b9-483c-8851-ae2a03744d9c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4939e819-74b9-483c-8851-ae2a03744d9c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4939e819-74b9-483c-8851-ae2a03744d9c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4939e819-74b9-483c-8851-ae2a03744d9c None None] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4939e819-74b9-483c-8851-ae2a03744d9c None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4939e819-74b9-483c-8851-ae2a03744d9c None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:18 user devstack@n-api.service[64872]: INFO nova.compute.rpcapi [None req-4939e819-74b9-483c-8851-ae2a03744d9c None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 06:38:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4939e819-74b9-483c-8851-ae2a03744d9c None None] Releasing lock "compute-rpcapi-router" {{(pid=64872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 06:38:18 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] validate_networks() for [('9cc44bb8-29ac-4bdc-9bc8-1e518e5e887a', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:38:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-f30d95cb-2440-4ad6-9c2f-14396821ecf3 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.917929 Nov 28 06:38:18 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 19/56] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:38:15 2023] POST /compute/v2.1/servers => generated 400 bytes in 2919 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:38:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4939e819-74b9-483c-8851-ae2a03744d9c None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150742 Nov 28 06:38:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 19/57] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-90f8c2ff-7b51-4c3d-b2cf-28e4607cf8c1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-90f8c2ff-7b51-4c3d-b2cf-28e4607cf8c1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:38:18 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-90f8c2ff-7b51-4c3d-b2cf-28e4607cf8c1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-90f8c2ff-7b51-4c3d-b2cf-28e4607cf8c1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433" status: 200 len: 1233 microversion: 2.1 time: 0.158339 Nov 28 06:38:18 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 20/58] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:38:18 2023] GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433 => generated 1233 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting quotas for project 739e836995bb4af6a877468ec43d0cf3. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting quotas for user 18ee95f099b64968984fd3b9e418b048 and project 739e836995bb4af6a877468ec43d0cf3. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:38:19 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:38:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-3199c35e-7800-4420-abfa-9041cc2b7552 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.110898 Nov 28 06:38:20 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 20/59] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:38:17 2023] POST /compute/v2.1/servers => generated 406 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:38:20 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-aab79b22-aa2d-4233-8837-216d78873827 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:38:20 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-aab79b22-aa2d-4233-8837-216d78873827 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:38:20 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-aab79b22-aa2d-4233-8837-216d78873827 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-aab79b22-aa2d-4233-8837-216d78873827 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1233 microversion: 2.1 time: 0.133398 Nov 28 06:38:20 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:38:20 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1233 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a8f46d-3105-4486-a8b4-1409c9c544c7", "tag": "ac8aece2-e749-4b38-8812-e9d4df591f41"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] Creating event network-changed:ac8aece2-e749-4b38-8812-e9d4df591f41 for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 on user Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=64873) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-63525922-8849-48e5-9953-14f511f0f781 req-14106daa-3389-4985-87e3-0569b87417f1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=64873) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f91af9c1-5c91-4130-a45e-25c9e1f67125 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f91af9c1-5c91-4130-a45e-25c9e1f67125 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f91af9c1-5c91-4130-a45e-25c9e1f67125 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f91af9c1-5c91-4130-a45e-25c9e1f67125 None None] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f91af9c1-5c91-4130-a45e-25c9e1f67125 None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f91af9c1-5c91-4130-a45e-25c9e1f67125 None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:20 user devstack@n-api.service[64873]: INFO nova.compute.rpcapi [None req-f91af9c1-5c91-4130-a45e-25c9e1f67125 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 06:38:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f91af9c1-5c91-4130-a45e-25c9e1f67125 None None] Releasing lock "compute-rpcapi-router" {{(pid=64873) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 06:38:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-f91af9c1-5c91-4130-a45e-25c9e1f67125 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097400 Nov 28 06:38:20 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 21/61] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b630563-12cc-467d-8908-e2a8fb230b62", "tag": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:21 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e", "tag": "505345c6-a079-468d-be35-64932bcaef25"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] Creating event network-changed:f14d8817-78b1-4d77-b312-3d5ccaab9d4a for instance 0b630563-12cc-467d-8908-e2a8fb230b62 on user Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=64871) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-640a170b-5954-4210-8b2d-44752ea31bd1 req-db52578e-cc14-4404-9651-7ec5790b7380 service nova] Acquired lock "compute-rpcapi-router" {{(pid=64871) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 06:38:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7a5b4589-aff8-4cbe-9255-5dbec3dae599 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7a5b4589-aff8-4cbe-9255-5dbec3dae599 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7a5b4589-aff8-4cbe-9255-5dbec3dae599 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7a5b4589-aff8-4cbe-9255-5dbec3dae599 None None] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7a5b4589-aff8-4cbe-9255-5dbec3dae599 None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7a5b4589-aff8-4cbe-9255-5dbec3dae599 None None] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:21 user devstack@n-api.service[64871]: INFO nova.compute.rpcapi [None req-7a5b4589-aff8-4cbe-9255-5dbec3dae599 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 06:38:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7a5b4589-aff8-4cbe-9255-5dbec3dae599 None None] Releasing lock "compute-rpcapi-router" {{(pid=64871) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 06:38:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] Creating event network-changed:505345c6-a079-468d-be35-64932bcaef25 for instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e on user Nov 28 06:38:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-2c537d4e-7afe-483e-8df0-0e406e0d238e req-77f9f6cf-a409-4556-a732-6a2b565bb00f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154309 Nov 28 06:38:21 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 21/62] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-7a5b4589-aff8-4cbe-9255-5dbec3dae599 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176912 Nov 28 06:38:21 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:23 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-692038908", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "c14a902d-8f0e-4a96-841e-176e395b16c9"}], "security_groups": [{"name": "tempest-securitygroup--741863802"}], "key_name": "tempest-keypair-142163135", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:24 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] validate_networks() for [('c14a902d-8f0e-4a96-841e-176e395b16c9', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Getting quotas for project b30dc21619f949b18be9362b217e7c1b. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Getting quotas for user 4f53e7a2f95545d196a5b2d36ef6d692 and project b30dc21619f949b18be9362b217e7c1b. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:38:25 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:38:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e4926aa8-5f56-4c36-b4b3-7bb75ff0abe7 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.937070 Nov 28 06:38:25 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 22/64] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:38:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:38:25 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-372c6424-e8d4-4bde-8891-569aa118de69 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:38:25 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-372c6424-e8d4-4bde-8891-569aa118de69 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:38:25 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4802806-6422-46da-8d0f-5674af0a8433", "tag": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:25 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] Creating event network-changed:1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance b4802806-6422-46da-8d0f-5674af0a8433 on user Nov 28 06:38:25 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-7eedb066-1710-494c-9243-4322d81259a6 req-eff7476e-1c41-4168-bf74-4e7a244720b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061455 Nov 28 06:38:25 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 22/65] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:26 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-372c6424-e8d4-4bde-8891-569aa118de69 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f53e7a2f95545d196a5b2d36ef6d692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30dc21619f949b18be9362b217e7c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:26 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-372c6424-e8d4-4bde-8891-569aa118de69 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620" status: 200 len: 1236 microversion: 2.1 time: 0.368833 Nov 28 06:38:26 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:38:25 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620 => generated 1236 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:38:26 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:26 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] Creating event network-changed:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:38:26 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-1e42f2cf-7712-4931-87ce-8c301d449ca7 req-303dc7ae-781b-4642-b155-97fb700b47f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039956 Nov 28 06:38:26 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 23/67] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:31 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:31 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=18 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:31 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] Creating event network-changed:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:38:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-b0594690-178d-46dd-b2d5-9585d5bcd133 req-87b61edf-03ea-4f73-8256-5f3708eea392 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074159 Nov 28 06:38:32 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 23/68] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:32 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=10 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:32 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=12 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:33 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-dfa0d43c-800e-4ec6-8734-0a19f8495894 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Action: 'create', calling method: .version_select at 0x7f0b089ac3a0>, body: {"keypair": {"name": "tempest-keypair-1078616029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMsHDWfSPBXeowpAfdbCkUBsb5GVuO2M2D2NvwxyTsWsRqGaxh5+cyygW6N+N2Y+05tishhYkLlG4xldaGcp+OIozUBSi77d0G9KooHgMQC8tV78aYf9oA5ssK3kLplYw=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:33 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-dfa0d43c-800e-4ec6-8734-0a19f8495894 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Getting quotas for project c265a98d205f4b679d3a810b4745691a. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:33 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-dfa0d43c-800e-4ec6-8734-0a19f8495894 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Getting quotas for user 3e8b23eae758490a8a2476797479f208 and project c265a98d205f4b679d3a810b4745691a. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-dfa0d43c-800e-4ec6-8734-0a19f8495894 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.605990 Nov 28 06:38:33 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 23/69] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:38:32 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=24 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=7 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=10 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-621014352", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "01113f65-069a-4a01-937f-ff095f88202b"}], "security_groups": [{"name": "tempest-securitygroup--303724854"}], "key_name": "tempest-keypair-1078616029", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:38 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] validate_networks() for [('01113f65-069a-4a01-937f-ff095f88202b', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:38:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d5e1179c-c758-47a6-af94-5809d94782f1 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Action: 'create', calling method: .version_select at 0x7f0b094d5ab0>, body: {"keypair": {"name": "tempest-keypair-926137104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNEi3e2JzcCpkjzBEiSZvejCbft/YLFcYrQL40RNJqMTTInfT/sTCCeFwes+Tmiq9CMXCarfk+xENzowL6bsuzmSB+K0docacw1kCH/oMTX2uXVEMErv/sdXvTkTOC5sw=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:40 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-d5e1179c-c758-47a6-af94-5809d94782f1 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Getting quotas for project 63d0402c76fe47cd8cd65d2ef23c46f8. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:40 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-d5e1179c-c758-47a6-af94-5809d94782f1 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Getting quotas for user ec7f2a6787cd478ca419181fdb7ab317 and project 63d0402c76fe47cd8cd65d2ef23c46f8. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Getting quotas for project c265a98d205f4b679d3a810b4745691a. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Getting quotas for user 3e8b23eae758490a8a2476797479f208 and project c265a98d205f4b679d3a810b4745691a. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:38:40 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:38:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d5e1179c-c758-47a6-af94-5809d94782f1 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.246922 Nov 28 06:38:40 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 24/70] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:38:40 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e72b6bcc-5adb-4e20-b1c5-02ff9a3cea16 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.707428 Nov 28 06:38:40 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 24/71] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:38:38 2023] POST /compute/v2.1/servers => generated 403 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:38:40 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-3353b69c-f453-4e0e-9077-17d9b071d783 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:38:40 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-3353b69c-f453-4e0e-9077-17d9b071d783 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:38:40 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-3353b69c-f453-4e0e-9077-17d9b071d783 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8b23eae758490a8a2476797479f208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c265a98d205f4b679d3a810b4745691a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-3353b69c-f453-4e0e-9077-17d9b071d783 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b" status: 200 len: 1233 microversion: 2.1 time: 0.207240 Nov 28 06:38:40 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 24/72] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:38:40 2023] GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b => generated 1233 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:38:42 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=12 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:42 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a8f46d-3105-4486-a8b4-1409c9c544c7", "name": "network-vif-plugged", "status": "completed", "tag": "ac8aece2-e749-4b38-8812-e9d4df591f41"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] Creating event network-vif-plugged:ac8aece2-e749-4b38-8812-e9d4df591f41 for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 on user Nov 28 06:38:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-fdf643dd-b3bd-4f8b-9062-4850caf7b754 req-5a9c195f-86ab-43df-97e7-0c6d00d57208 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056951 Nov 28 06:38:42 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 25/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:44 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a8f46d-3105-4486-a8b4-1409c9c544c7", "name": "network-vif-plugged", "status": "completed", "tag": "ac8aece2-e749-4b38-8812-e9d4df591f41"}, {"server_uuid": "b4802806-6422-46da-8d0f-5674af0a8433", "name": "network-vif-plugged", "status": "completed", "tag": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:44 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Creating event network-vif-plugged:ac8aece2-e749-4b38-8812-e9d4df591f41 for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 on user Nov 28 06:38:44 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] Creating event network-vif-plugged:1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance b4802806-6422-46da-8d0f-5674af0a8433 on user Nov 28 06:38:44 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-1f225ce4-a904-43fb-82a2-8d7d7e21a43c req-89021afb-21a2-4f99-9482-aa5c6141bcde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079812 Nov 28 06:38:44 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:45 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-plugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] Creating event network-vif-plugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:38:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-eaa9ac43-fe6b-40f5-9573-385fa2ef6d5e req-c218a1d0-09c9-4c6a-9406-67e804b3977a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184526 Nov 28 06:38:45 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4802806-6422-46da-8d0f-5674af0a8433", "name": "network-vif-plugged", "status": "completed", "tag": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a"}, {"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-plugged", "status": "completed", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}, {"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-plugged", "status": "completed", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Creating event network-vif-plugged:1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance b4802806-6422-46da-8d0f-5674af0a8433 on user Nov 28 06:38:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Creating event network-vif-plugged:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:38:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] Creating event network-vif-plugged:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:38:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-082cc15b-e4c6-4d20-b363-0ee98ee06c77 req-11194be2-c53a-43f4-bfae-ce0412e64510 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.276740 Nov 28 06:38:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 26/76] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:46 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:47 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-517497179", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "2fa8c0e7-da73-4b99-9772-79fc2aae5970"}], "security_groups": [{"name": "tempest-securitygroup--1125440404"}], "key_name": "tempest-keypair-926137104", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:47 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] validate_networks() for [('2fa8c0e7-da73-4b99-9772-79fc2aae5970', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:38:47 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-plugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}, {"server_uuid": "0b630563-12cc-467d-8908-e2a8fb230b62", "name": "network-vif-plugged", "status": "completed", "tag": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a"}, {"server_uuid": "0b630563-12cc-467d-8908-e2a8fb230b62", "name": "network-vif-plugged", "status": "completed", "tag": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Creating event network-vif-plugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:38:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Creating event network-vif-plugged:f14d8817-78b1-4d77-b312-3d5ccaab9d4a for instance 0b630563-12cc-467d-8908-e2a8fb230b62 on user Nov 28 06:38:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] Creating event network-vif-plugged:f14d8817-78b1-4d77-b312-3d5ccaab9d4a for instance 0b630563-12cc-467d-8908-e2a8fb230b62 on user Nov 28 06:38:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-018175b2-b248-44ca-a26d-699d07a5a624 req-f515f766-f612-45f8-a299-f49ae34864ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.081450 Nov 28 06:38:48 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:47 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:48 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636fad3b-617f-4a65-8cf7-ef67fd68304b", "tag": "519d15c3-a87c-436b-aa7d-b6754a055382"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Getting quotas for project 63d0402c76fe47cd8cd65d2ef23c46f8. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Getting quotas for user ec7f2a6787cd478ca419181fdb7ab317 and project 63d0402c76fe47cd8cd65d2ef23c46f8. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:38:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:48 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:38:48 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] Creating event network-changed:519d15c3-a87c-436b-aa7d-b6754a055382 for instance 636fad3b-617f-4a65-8cf7-ef67fd68304b on user Nov 28 06:38:48 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-b96c16a8-7b1b-4e2a-9e44-81938ddb0501 req-4205e85a-30b1-48eb-90e0-fe032370bfec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084507 Nov 28 06:38:48 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 27/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-46da9d63-6517-4f2a-85c6-78637d77e200 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.673717 Nov 28 06:38:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 26/79] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:38:47 2023] POST /compute/v2.1/servers => generated 404 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:38:49 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d1f4bad6-d3d5-47b9-83a2-a5b9c3e5cf9c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:38:49 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d1f4bad6-d3d5-47b9-83a2-a5b9c3e5cf9c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:38:49 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d1f4bad6-d3d5-47b9-83a2-a5b9c3e5cf9c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7f2a6787cd478ca419181fdb7ab317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0402c76fe47cd8cd65d2ef23c46f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:49 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d1f4bad6-d3d5-47b9-83a2-a5b9c3e5cf9c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7" status: 200 len: 1222 microversion: 2.1 time: 0.111416 Nov 28 06:38:49 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 27/80] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:38:49 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7 => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:38:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b4feaa39-e0c7-4a56-aaf2-ae32bebcf725 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Action: 'create', calling method: .version_select at 0x7f0b03f5a5f0>, body: {"keypair": {"name": "tempest-keypair-1012101206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlsgIHBkjqeXLgCZOFjOk2R3rFX+Exf4pm9jd/j6HnEa74ku0fNjIAuyGrYRiG220+GjsvdmFmAGshilmUdIU2Uzk7IAbyaHHmjO0U8FLqIFGGoaUXURCrhv/WaOkKAsw=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:49 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-b4feaa39-e0c7-4a56-aaf2-ae32bebcf725 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Getting quotas for project 7f8c916eb72b4f5cb1b3fa97845e2072. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:49 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-b4feaa39-e0c7-4a56-aaf2-ae32bebcf725 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Getting quotas for user 0f854afd1c504c7ba7eea6643d7bc7c9 and project 7f8c916eb72b4f5cb1b3fa97845e2072. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b4feaa39-e0c7-4a56-aaf2-ae32bebcf725 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.417506 Nov 28 06:38:49 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 28/81] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:38:49 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:50 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e", "name": "network-vif-plugged", "status": "completed", "tag": "505345c6-a079-468d-be35-64932bcaef25"}, {"server_uuid": "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e", "name": "network-vif-plugged", "status": "completed", "tag": "505345c6-a079-468d-be35-64932bcaef25"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:50 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Creating event network-vif-plugged:505345c6-a079-468d-be35-64932bcaef25 for instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e on user Nov 28 06:38:50 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] Creating event network-vif-plugged:505345c6-a079-468d-be35-64932bcaef25 for instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e on user Nov 28 06:38:50 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-3f35ee24-a726-437c-83e8-54982b82ed4c req-58f1dfea-3550-409a-8815-de94a01a6c8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068269 Nov 28 06:38:50 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAssistedSnapshotsTest-server-2057452123", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "ef315ae7-1984-498d-9a2d-19fe658a6019"}], "security_groups": [{"name": "tempest-securitygroup--428717315"}], "key_name": "tempest-keypair-1012101206", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] validate_networks() for [('ef315ae7-1984-498d-9a2d-19fe658a6019', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:38:53 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c94c69-4907-404d-ad02-d8ba2716a4e7", "tag": "affac6e2-50a7-44d2-b7ba-ec18341bb71f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] Creating event network-changed:affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 on user Nov 28 06:38:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-ec2c4480-5fa3-4114-8bbb-cbf7025cc005 req-48cfa562-3699-4e03-9770-1eb050e795bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042922 Nov 28 06:38:53 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 29/83] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:54 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Getting quotas for project 7f8c916eb72b4f5cb1b3fa97845e2072. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:38:54 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Getting quotas for user 0f854afd1c504c7ba7eea6643d7bc7c9 and project 7f8c916eb72b4f5cb1b3fa97845e2072. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:38:54 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:38:54 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:38:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a21d47f5-d8c2-4957-b2b0-8a5068161ef5 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.988115 Nov 28 06:38:54 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 28/84] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:38:53 2023] POST /compute/v2.1/servers => generated 403 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:38:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8e769c22-cfd2-4277-9aa0-d010db6c1ea2 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:38:54 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8e769c22-cfd2-4277-9aa0-d010db6c1ea2 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:38:54 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-8e769c22-cfd2-4277-9aa0-d010db6c1ea2 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f854afd1c504c7ba7eea6643d7bc7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8c916eb72b4f5cb1b3fa97845e2072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:38:54 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-8e769c22-cfd2-4277-9aa0-d010db6c1ea2 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00" status: 200 len: 1238 microversion: 2.1 time: 0.112092 Nov 28 06:38:54 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 28/85] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:38:54 2023] GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00 => generated 1238 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:38:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3406c2b-4e6e-4be0-b84a-168c59322f00", "tag": "44cb2e46-5eae-4728-ac61-29177ecb06f6"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] Creating event network-changed:44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance e3406c2b-4e6e-4be0-b84a-168c59322f00 on user Nov 28 06:38:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-1afa2a0d-506f-407e-92fd-eb94d6f6bb7a req-c7048056-3aa8-4cb6-8973-94afe421905f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028472 Nov 28 06:38:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 30/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:58 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c94c69-4907-404d-ad02-d8ba2716a4e7", "name": "network-vif-plugged", "status": "completed", "tag": "affac6e2-50a7-44d2-b7ba-ec18341bb71f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:38:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:38:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:38:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] Creating event network-vif-plugged:affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 on user Nov 28 06:38:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-2862ff68-2574-4b5f-bda5-08ffd0e04b4b req-7642764a-2818-4623-9dbb-f24140557605 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048897 Nov 28 06:38:58 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 29/87] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:38:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:38:59 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsV293TestJSON-server-1245407202", "imageRef": "", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "93e28135-a46b-4832-9244-5f214e1915c4"}], "security_groups": [{"name": "tempest-securitygroup--1921054829"}], "key_name": "tempest-keypair-885228878", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "1d9c5b72-fcf3-422e-bee9-f2fffafb9d92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, ": true}]}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:38:59 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:38:59 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] validate_networks() for [('93e28135-a46b-4832-9244-5f214e1915c4', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=8 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:00 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=8 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-plugged", "status": "completed", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] Creating event network-vif-plugged:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:39:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-852b1b91-bc1a-47a1-ad15-aab8f79f1300 req-aa0fa1fc-75e0-4986-94a6-eb2b5ba7d92e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071404 Nov 28 06:39:00 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 31/88] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting quotas for project ff4ac048770a4680a35f71465d191d49. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting quotas for user 48e7c51916684bec98970a963f2c560e and project ff4ac048770a4680a35f71465d191d49. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:39:00 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1d9c5b72-fcf3-422e-bee9-f2fffafb9d92',volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:39:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-05544af0-308c-41f0-9702-eeee7f5adfe2 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.93 time: 1.222839 Nov 28 06:39:00 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 29/89] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 06:38:59 2023] POST /compute/v2.1/servers => generated 407 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 06:39:00 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9737eef6-738c-48ee-b143-5439db5dca23 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:00 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-9737eef6-738c-48ee-b143-5439db5dca23 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c94c69-4907-404d-ad02-d8ba2716a4e7", "name": "network-vif-plugged", "status": "completed", "tag": "affac6e2-50a7-44d2-b7ba-ec18341bb71f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:01 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-9737eef6-738c-48ee-b143-5439db5dca23 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:01 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-9737eef6-738c-48ee-b143-5439db5dca23 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:01 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-9737eef6-738c-48ee-b143-5439db5dca23 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:01 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9737eef6-738c-48ee-b143-5439db5dca23 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079" status: 200 len: 1333 microversion: 2.93 time: 0.127277 Nov 28 06:39:01 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 30/90] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:39:00 2023] GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079 => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:39:01 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] Creating event network-vif-plugged:affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 on user Nov 28 06:39:01 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-2b8bd028-6066-4c30-a245-02439691aeba req-5c8cb01a-0825-4d96-a1f2-ff5dca800f4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102701 Nov 28 06:39:01 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 32/91] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:02 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-plugged", "status": "completed", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:02 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] Creating event network-vif-plugged:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:39:02 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-04e69078-62f3-4b16-b9b2-201709fce4f5 req-6e806b4e-dfb0-48c1-b1a1-23b3a65571d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128523 Nov 28 06:39:02 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 30/92] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:02 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-0f5a3b82-80cd-4860-b0cb-c2651391f323 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:02 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-0f5a3b82-80cd-4860-b0cb-c2651391f323 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0f5a3b82-80cd-4860-b0cb-c2651391f323 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0f5a3b82-80cd-4860-b0cb-c2651391f323 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0f5a3b82-80cd-4860-b0cb-c2651391f323 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0f5a3b82-80cd-4860-b0cb-c2651391f323 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0f5a3b82-80cd-4860-b0cb-c2651391f323 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0f5a3b82-80cd-4860-b0cb-c2651391f323 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:03 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7632c850-51cc-4721-a22c-b42816683345 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:03 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7632c850-51cc-4721-a22c-b42816683345 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7632c850-51cc-4721-a22c-b42816683345 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7632c850-51cc-4721-a22c-b42816683345 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7632c850-51cc-4721-a22c-b42816683345 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7632c850-51cc-4721-a22c-b42816683345 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7632c850-51cc-4721-a22c-b42816683345 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7632c850-51cc-4721-a22c-b42816683345 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:03 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-0f5a3b82-80cd-4860-b0cb-c2651391f323 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:03 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-0f5a3b82-80cd-4860-b0cb-c2651391f323 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7" status: 200 len: 1500 microversion: 2.1 time: 1.011038 Nov 28 06:39:03 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 31/93] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:39:02 2023] GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7 => generated 1500 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:39:04 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-7632c850-51cc-4721-a22c-b42816683345 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7632c850-51cc-4721-a22c-b42816683345 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" status: 200 len: 1491 microversion: 2.1 time: 0.926778 Nov 28 06:39:04 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 33/94] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:39:03 2023] GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e => generated 1491 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:39:05 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] Creating event network-changed:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:39:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-112f5a8a-06d6-40ed-baf1-1b78a79b6b77 req-d508be60-1b06-4752-9256-51026a69285e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041227 Nov 28 06:39:05 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:05 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:05 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d7e02e34-f4c8-4981-bb25-a985f0bb0ed1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62" status: 200 len: 1692 microversion: 2.87 time: 0.372306 Nov 28 06:39:05 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 32/96] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:39:05 2023] GET /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62 => generated 1692 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:39:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636fad3b-617f-4a65-8cf7-ef67fd68304b", "name": "network-vif-plugged", "status": "completed", "tag": "519d15c3-a87c-436b-aa7d-b6754a055382"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] Creating event network-vif-plugged:519d15c3-a87c-436b-aa7d-b6754a055382 for instance 636fad3b-617f-4a65-8cf7-ef67fd68304b on user Nov 28 06:39:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-85a6781a-6d7d-4585-8892-9485de7ef303 req-ee26a0c9-5168-47fd-88e0-ba9e7b8eb7f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050645 Nov 28 06:39:06 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 34/97] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-60df0066-61c9-4a15-a3fb-a54077cf845d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:08 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-60df0066-61c9-4a15-a3fb-a54077cf845d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60df0066-61c9-4a15-a3fb-a54077cf845d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60df0066-61c9-4a15-a3fb-a54077cf845d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60df0066-61c9-4a15-a3fb-a54077cf845d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60df0066-61c9-4a15-a3fb-a54077cf845d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60df0066-61c9-4a15-a3fb-a54077cf845d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60df0066-61c9-4a15-a3fb-a54077cf845d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:08 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636fad3b-617f-4a65-8cf7-ef67fd68304b", "name": "network-vif-plugged", "status": "completed", "tag": "519d15c3-a87c-436b-aa7d-b6754a055382"}, {"server_uuid": "e3406c2b-4e6e-4be0-b84a-168c59322f00", "name": "network-vif-plugged", "status": "completed", "tag": "44cb2e46-5eae-4728-ac61-29177ecb06f6"}, {"server_uuid": "e3406c2b-4e6e-4be0-b84a-168c59322f00", "name": "network-vif-plugged", "status": "completed", "tag": "44cb2e46-5eae-4728-ac61-29177ecb06f6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:08 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=124,nova_api:INSERT=17 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:08 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Creating event network-vif-plugged:519d15c3-a87c-436b-aa7d-b6754a055382 for instance 636fad3b-617f-4a65-8cf7-ef67fd68304b on user Nov 28 06:39:08 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Creating event network-vif-plugged:44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance e3406c2b-4e6e-4be0-b84a-168c59322f00 on user Nov 28 06:39:08 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] Creating event network-vif-plugged:44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance e3406c2b-4e6e-4be0-b84a-168c59322f00 on user Nov 28 06:39:08 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-ed90e85b-fbc6-4b1e-a096-3e3ffc8d644d req-341cdb13-7bf3-4568-8304-17ea257e9be2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044059 Nov 28 06:39:08 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 33/98] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:08 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:39:09 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-60df0066-61c9-4a15-a3fb-a54077cf845d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-60df0066-61c9-4a15-a3fb-a54077cf845d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433" status: 200 len: 1544 microversion: 2.1 time: 0.544028 Nov 28 06:39:09 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 32/99] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:39:08 2023] GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433 => generated 1544 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:39:10 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-29bbdbe3-8392-4aa3-9782-ab35f1f940e3 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:10 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-29bbdbe3-8392-4aa3-9782-ab35f1f940e3 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-29bbdbe3-8392-4aa3-9782-ab35f1f940e3 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-29bbdbe3-8392-4aa3-9782-ab35f1f940e3 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-29bbdbe3-8392-4aa3-9782-ab35f1f940e3 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-29bbdbe3-8392-4aa3-9782-ab35f1f940e3 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-29bbdbe3-8392-4aa3-9782-ab35f1f940e3 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-29bbdbe3-8392-4aa3-9782-ab35f1f940e3 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:10 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-29bbdbe3-8392-4aa3-9782-ab35f1f940e3 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-29bbdbe3-8392-4aa3-9782-ab35f1f940e3 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1540 microversion: 2.1 time: 0.312283 Nov 28 06:39:10 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 35/100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:39:10 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1540 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:39:14 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=46 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:14 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6ba1fa83-35d9-403d-8586-06376591e3bd tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Action: 'create', calling method: .version_select at 0x7f0b03f3d090>, body: {"keypair": {"name": "tempest-keypair-1304188480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIQxAW+Qr5l07yx8o2s2/6Ie6cvY9ZUwYQ5bsC6U28gF9hXATu7vm5p8BVWQFuPbhu081HtTqqAUFQCW0LcgtOoJU38C37nQG5BQZndxGVtkTQ+HBU8HBl+DvL0+YoIlQ=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:14 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-6ba1fa83-35d9-403d-8586-06376591e3bd tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Getting quotas for project 49de64e4ec95433297cb192cadd60402. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:39:14 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-6ba1fa83-35d9-403d-8586-06376591e3bd tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Getting quotas for user 58a9aacbcb174f658f3cbba2e84d6e5b and project 49de64e4ec95433297cb192cadd60402. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:39:14 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6ba1fa83-35d9-403d-8586-06376591e3bd tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.058132 Nov 28 06:39:14 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 34/101] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 06:39:14 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 06:39:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1923245599", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "27390ae5-3a4f-49b4-8aa8-de6a4b292636"}, {"port": "b1021f35-3b88-4288-818c-325753086daf", "tag": "port-1"}, {"port": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65", "tag": "port-2"}, {"uuid": "6c88a186-bf0b-411c-9931-49526e390fc8", "tag": "net-1"}, {"uuid": "6c88a186-bf0b-411c-9931-49526e390fc8"}, {"uuid": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b1cad690-a1fd-44ad-9289-98a4516b4fe4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3d001b09-312c-44d4-a06d-03d7e311f349", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "cfaded18-7989-4c10-bd0b-ab1878aed584", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1480865310"}], "key_name": "tempest-keypair-1304188480", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:16 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:16 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=20 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:16 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-94f2f9e1-dd15-4a32-91cd-a1c7dfaec506 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:16 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-94f2f9e1-dd15-4a32-91cd-a1c7dfaec506 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:16 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=7 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-94f2f9e1-dd15-4a32-91cd-a1c7dfaec506 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-94f2f9e1-dd15-4a32-91cd-a1c7dfaec506 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-94f2f9e1-dd15-4a32-91cd-a1c7dfaec506 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-94f2f9e1-dd15-4a32-91cd-a1c7dfaec506 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-94f2f9e1-dd15-4a32-91cd-a1c7dfaec506 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-94f2f9e1-dd15-4a32-91cd-a1c7dfaec506 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:16 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] validate_networks() for [('27390ae5-3a4f-49b4-8aa8-de6a4b292636', None, None, None, None, None), (None, None, 'b1021f35-3b88-4288-818c-325753086daf', None, None, None), (None, None, 'cf5914b8-0656-47c2-ba2c-2fe6d04a6a65', None, None, None), ('6c88a186-bf0b-411c-9931-49526e390fc8', None, None, None, None, None), ('6c88a186-bf0b-411c-9931-49526e390fc8', None, None, None, None, None), ('b1cad690-a1fd-44ad-9289-98a4516b4fe4', '10.2.2.100', None, None, None, None), ('b1cad690-a1fd-44ad-9289-98a4516b4fe4', '10.2.2.200', None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:39:16 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-94f2f9e1-dd15-4a32-91cd-a1c7dfaec506 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f53e7a2f95545d196a5b2d36ef6d692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30dc21619f949b18be9362b217e7c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-94f2f9e1-dd15-4a32-91cd-a1c7dfaec506 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620" status: 200 len: 1548 microversion: 2.1 time: 0.239872 Nov 28 06:39:16 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 36/102] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:39:16 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620 => generated 1548 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:39:18 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "name": "network-vif-plugged", "status": "completed", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] Creating event network-vif-plugged:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:39:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-817b23d9-728e-438f-8185-e2e6d740854f req-377ad1c6-af87-4ac2-ac48-cadcc65c55c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037886 Nov 28 06:39:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 35/103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Getting quotas for project 49de64e4ec95433297cb192cadd60402. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Getting quotas for user 58a9aacbcb174f658f3cbba2e84d6e5b and project 49de64e4ec95433297cb192cadd60402. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:39:18 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='747dcb4e-ca47-4dcf-a6bd-dccf9cb7441c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3d001b09-312c-44d4-a06d-03d7e311f349',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cfaded18-7989-4c10-bd0b-ab1878aed584',volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:39:19 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d55f79ea-77d0-4447-9ca3-23104c4861d8 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.046296 Nov 28 06:39:19 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 33/104] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 28 06:39:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 3048 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 06:39:19 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a48a0ce2-9e09-4dfe-b5fb-0de16e7f08ed tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:19 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a48a0ce2-9e09-4dfe-b5fb-0de16e7f08ed tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:19 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-a48a0ce2-9e09-4dfe-b5fb-0de16e7f08ed tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:19 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-a48a0ce2-9e09-4dfe-b5fb-0de16e7f08ed tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:19 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-a48a0ce2-9e09-4dfe-b5fb-0de16e7f08ed tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:19 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a48a0ce2-9e09-4dfe-b5fb-0de16e7f08ed tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee" status: 200 len: 1278 microversion: 2.32 time: 0.072681 Nov 28 06:39:19 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 37/105] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:39:19 2023] GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee => generated 1278 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:39:20 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "name": "network-vif-plugged", "status": "completed", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] Creating event network-vif-plugged:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:39:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-9f301236-95ed-4ace-8c1f-cc75986d4b35 req-1273984f-85d8-490e-bef6-84a4185ee4d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030145 Nov 28 06:39:20 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 36/106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "tag": "1c17febf-a6ee-4954-9d0c-f6282ae774ea"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] Creating event network-changed:1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-40871c4b-ea21-45f9-aa86-437c164f5536 req-3796ed6c-9981-4318-9418-a39f44024126 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032590 Nov 28 06:39:24 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 34/107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:26 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "tag": "b1021f35-3b88-4288-818c-325753086daf"}, {"name": "network-changed", "server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "tag": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:26 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=34 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:26 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Creating event network-changed:b1021f35-3b88-4288-818c-325753086daf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:26 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] Creating event network-changed:cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:26 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-d7d8eeda-9686-4fee-9a17-8cebfddd3e00 req-7a7dbe72-e5e7-4de8-84cd-37a2248d6e24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039539 Nov 28 06:39:26 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 38/108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:26 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:28 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:28 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "tag": "a7a63db6-53d0-4e2f-acad-d649701a3f90"}, {"name": "network-changed", "server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "tag": "97c7e28d-01ae-4b01-8594-2e507f37eeb7"}, {"name": "network-changed", "server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "tag": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Creating event network-changed:a7a63db6-53d0-4e2f-acad-d649701a3f90 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Creating event network-changed:97c7e28d-01ae-4b01-8594-2e507f37eeb7 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] Creating event network-changed:7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-79b0517e-14c1-413d-a74a-63f3a86b98b8 req-91028009-7ca4-4a76-93d0-4b6e9860dc7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.046942 Nov 28 06:39:28 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 37/109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:28 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-31850c9f-3076-48ab-9714-460d19ff2c01 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-31850c9f-3076-48ab-9714-460d19ff2c01 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-31850c9f-3076-48ab-9714-460d19ff2c01 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-31850c9f-3076-48ab-9714-460d19ff2c01 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-31850c9f-3076-48ab-9714-460d19ff2c01 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-31850c9f-3076-48ab-9714-460d19ff2c01 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-31850c9f-3076-48ab-9714-460d19ff2c01 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-31850c9f-3076-48ab-9714-460d19ff2c01 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:30 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "tag": "6192ac90-a8ff-46d9-914f-ab6894136423"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] Creating event network-changed:6192ac90-a8ff-46d9-914f-ab6894136423 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-454d8f1f-849f-489c-95c1-c7b75b5685dd req-b12d7c12-d906-40c5-953c-a074afbe57b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046589 Nov 28 06:39:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 39/110] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:30 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-31850c9f-3076-48ab-9714-460d19ff2c01 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8b23eae758490a8a2476797479f208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c265a98d205f4b679d3a810b4745691a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:30 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-31850c9f-3076-48ab-9714-460d19ff2c01 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b" status: 200 len: 1542 microversion: 2.1 time: 0.314043 Nov 28 06:39:30 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 35/111] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:39:30 2023] GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b => generated 1542 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=28 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-be148864-16d4-43b4-8395-12f369b3a076 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-be148864-16d4-43b4-8395-12f369b3a076 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-be148864-16d4-43b4-8395-12f369b3a076 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-be148864-16d4-43b4-8395-12f369b3a076 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-be148864-16d4-43b4-8395-12f369b3a076 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-be148864-16d4-43b4-8395-12f369b3a076 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-be148864-16d4-43b4-8395-12f369b3a076 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-be148864-16d4-43b4-8395-12f369b3a076 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:39 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-be148864-16d4-43b4-8395-12f369b3a076 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7f2a6787cd478ca419181fdb7ab317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0402c76fe47cd8cd65d2ef23c46f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:39 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-be148864-16d4-43b4-8395-12f369b3a076 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7" status: 200 len: 1521 microversion: 2.1 time: 0.227800 Nov 28 06:39:39 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 38/112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:39:39 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=9 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b3cdb84f-f52c-4cbf-9fff-817d10838681 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-b3cdb84f-f52c-4cbf-9fff-817d10838681 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b3cdb84f-f52c-4cbf-9fff-817d10838681 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b3cdb84f-f52c-4cbf-9fff-817d10838681 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b3cdb84f-f52c-4cbf-9fff-817d10838681 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b3cdb84f-f52c-4cbf-9fff-817d10838681 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b3cdb84f-f52c-4cbf-9fff-817d10838681 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b3cdb84f-f52c-4cbf-9fff-817d10838681 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:44 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-b3cdb84f-f52c-4cbf-9fff-817d10838681 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f854afd1c504c7ba7eea6643d7bc7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8c916eb72b4f5cb1b3fa97845e2072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:44 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b3cdb84f-f52c-4cbf-9fff-817d10838681 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00" status: 200 len: 1549 microversion: 2.1 time: 0.233498 Nov 28 06:39:44 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 40/113] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:39:44 2023] GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00 => generated 1549 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=12 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=22 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:51 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:39:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-de9eb859-a612-4032-be23-151e8b9cdfde tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079" status: 200 len: 1721 microversion: 2.93 time: 0.249581 Nov 28 06:39:51 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 36/114] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:39:51 2023] GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:39:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "1c17febf-a6ee-4954-9d0c-f6282ae774ea"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] Creating event network-vif-plugged:1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-991fc9eb-506e-4905-9a82-52d6e222d894 req-717e93d0-3196-4af2-b306-a33bc73af681 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035574 Nov 28 06:39:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 39/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:58 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:58 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:39:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:58 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] Creating event network-vif-plugged:cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:58 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-e9dedace-4bcf-47c5-ad48-f3b51443b2a6 req-70e9a604-a655-4a9a-b8d9-9bde9099c6b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106402 Nov 28 06:39:58 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 41/116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:39:59 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "1c17febf-a6ee-4954-9d0c-f6282ae774ea"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "b1021f35-3b88-4288-818c-325753086daf"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "b1021f35-3b88-4288-818c-325753086daf"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:39:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:39:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:39:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:39:59 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Creating event network-vif-plugged:1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:59 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Creating event network-vif-plugged:b1021f35-3b88-4288-818c-325753086daf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:59 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] Creating event network-vif-plugged:b1021f35-3b88-4288-818c-325753086daf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:39:59 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-8e23e785-d373-4e4f-9bc9-aa94c75ede2e req-7fa077a7-815f-42d4-94d1-d93e1fcfce7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037720 Nov 28 06:39:59 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 37/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:39:59 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:00 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "a7a63db6-53d0-4e2f-acad-d649701a3f90"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "a7a63db6-53d0-4e2f-acad-d649701a3f90"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Creating event network-vif-plugged:cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:40:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Creating event network-vif-plugged:a7a63db6-53d0-4e2f-acad-d649701a3f90 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:40:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] Creating event network-vif-plugged:a7a63db6-53d0-4e2f-acad-d649701a3f90 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:40:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-32c45f08-df5b-485c-b246-97471aec27dc req-047511c9-24a9-4099-992a-295e6d44ccb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048655 Nov 28 06:40:00 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:00 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:01 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:01 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Creating event network-vif-plugged:7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:40:01 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] Creating event network-vif-plugged:7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:40:01 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-d7be56a0-f034-4fb3-b5df-d9f77f9ff939 req-c3fb913e-2174-43cb-aa81-eedf2b84eb80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030658 Nov 28 06:40:01 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 42/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:01 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "97c7e28d-01ae-4b01-8594-2e507f37eeb7"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] Creating event network-vif-plugged:97c7e28d-01ae-4b01-8594-2e507f37eeb7 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:40:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-2d839e67-d2e6-4102-9c2a-c3ce39ddf3c9 req-daeac0c3-52cd-41c0-9f7b-2e9b98270ec0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Nov 28 06:40:01 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 38/120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:03 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "97c7e28d-01ae-4b01-8594-2e507f37eeb7"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "6192ac90-a8ff-46d9-914f-ab6894136423"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "6192ac90-a8ff-46d9-914f-ab6894136423"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:03 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Creating event network-vif-plugged:97c7e28d-01ae-4b01-8594-2e507f37eeb7 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:40:03 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Creating event network-vif-plugged:6192ac90-a8ff-46d9-914f-ab6894136423 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:40:03 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] Creating event network-vif-plugged:6192ac90-a8ff-46d9-914f-ab6894136423 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:40:03 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-0c5b3bf4-f014-4ff5-9f8a-149f5cfc8a29 req-4b89b121-5d92-4fed-abe1-77d52660f1e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.030643 Nov 28 06:40:03 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 41/121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:03 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:03 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:03 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:04 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'flavor' on Instance uuid 94a8f46d-3105-4486-a8b4-1409c9c544c7 {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:40:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4fe13e3b-2d7b-4aa4-9da9-512967081f91 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7/action" status: 200 len: 32 microversion: 2.1 time: 0.199049 Nov 28 06:40:04 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 43/122] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:40:03 2023] POST /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:40:04 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d9c9e0e2-5507-4d96-b66b-baa115b353a9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:04 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d9c9e0e2-5507-4d96-b66b-baa115b353a9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d9c9e0e2-5507-4d96-b66b-baa115b353a9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d9c9e0e2-5507-4d96-b66b-baa115b353a9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d9c9e0e2-5507-4d96-b66b-baa115b353a9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d9c9e0e2-5507-4d96-b66b-baa115b353a9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d9c9e0e2-5507-4d96-b66b-baa115b353a9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d9c9e0e2-5507-4d96-b66b-baa115b353a9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1921302970", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] validate_networks() for [('25e958b1-76c6-4b10-aa2d-7792c3a7c44a', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:40:04 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-d9c9e0e2-5507-4d96-b66b-baa115b353a9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d9c9e0e2-5507-4d96-b66b-baa115b353a9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7" status: 200 len: 1506 microversion: 2.1 time: 0.398562 Nov 28 06:40:04 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 39/123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:40:04 2023] GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Getting quotas for project 6362608255de47c3afa716e3091af3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Getting quotas for user 5bd89a43a3bf4952a40cd1dd07de2442 and project 6362608255de47c3afa716e3091af3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:40:04 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:40:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ecbd5de4-e449-4ea1-a826-c648e893ebfa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.494282 Nov 28 06:40:04 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 42/124] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:40:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:40:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f7bbfab2-26a0-4d1b-a70f-7566fb2a1bb2 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:04 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f7bbfab2-26a0-4d1b-a70f-7566fb2a1bb2 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:05 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-f7bbfab2-26a0-4d1b-a70f-7566fb2a1bb2 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:05 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f7bbfab2-26a0-4d1b-a70f-7566fb2a1bb2 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025" status: 200 len: 1209 microversion: 2.1 time: 0.105729 Nov 28 06:40:05 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 44/125] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:40:04 2023] GET /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:40:05 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a8f46d-3105-4486-a8b4-1409c9c544c7", "name": "network-vif-unplugged", "status": "completed", "tag": "ac8aece2-e749-4b38-8812-e9d4df591f41"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] Creating event network-vif-unplugged:ac8aece2-e749-4b38-8812-e9d4df591f41 for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 on user Nov 28 06:40:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-29dbbd71-1307-4f2e-949c-dd2193065580 req-07141777-02fd-42a1-b6ba-42d8e03cda41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035333 Nov 28 06:40:05 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 40/126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:06 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-2139078653"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:06 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:07 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a8f46d-3105-4486-a8b4-1409c9c544c7", "name": "network-vif-plugged", "status": "completed", "tag": "ac8aece2-e749-4b38-8812-e9d4df591f41"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:07 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f2e9be77-5f11-4150-9661-754c21e28486 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Action: 'create', calling method: .version_select at 0x7f0b03f592d0>, body: {"keypair": {"name": "tempest-TestStampPattern-1173073735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5sa3lTLV5w8Es1Zwm5A7hBFMTriUmYiPJX1od7Fq8D77dwHO4D7VBwSL79aNgiFnbekMIR0FimRxQa+i717+nJOsiauhlPuAXLp2kl0Df/MA8o3E+gC3WI9lFhWer50A=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:07 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-691bc89f-02c1-4f3f-ae72-db1bf549c2e3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62/action" status: 202 len: 52 microversion: 2.87 time: 1.190840 Nov 28 06:40:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:07 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 43/127] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 06:40:06 2023] POST /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62/action => generated 52 bytes in 1192 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 28 06:40:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:07 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] Creating event network-vif-plugged:ac8aece2-e749-4b38-8812-e9d4df591f41 for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 on user Nov 28 06:40:07 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-5bcf1aa3-1f0d-47d5-a963-929454307f6e req-bb437be0-684f-4107-b1cc-03eaad109aa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052046 Nov 28 06:40:07 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 41/128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:07 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-f2e9be77-5f11-4150-9661-754c21e28486 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Getting quotas for project 48cff8da56da484d9dfee1b8118474b9. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:40:07 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-f2e9be77-5f11-4150-9661-754c21e28486 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Getting quotas for user 73373ee05e1b4e09b5c0870750a77262 and project 48cff8da56da484d9dfee1b8118474b9. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:40:07 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f2e9be77-5f11-4150-9661-754c21e28486 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.380363 Nov 28 06:40:07 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 45/129] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:40:06 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:40:09 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b75c4d9c-4b49-4059-863b-daee51ae44af tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:09 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-b75c4d9c-4b49-4059-863b-daee51ae44af tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b75c4d9c-4b49-4059-863b-daee51ae44af tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b75c4d9c-4b49-4059-863b-daee51ae44af tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b75c4d9c-4b49-4059-863b-daee51ae44af tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b75c4d9c-4b49-4059-863b-daee51ae44af tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b75c4d9c-4b49-4059-863b-daee51ae44af tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b75c4d9c-4b49-4059-863b-daee51ae44af tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:09 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:09 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:09 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317be079-9b77-4139-88a4-36efb848c025", "tag": "61814597-e5ae-41b8-9cfb-2de8d8f596ef"}, {"server_uuid": "94a8f46d-3105-4486-a8b4-1409c9c544c7", "name": "network-vif-plugged", "status": "completed", "tag": "ac8aece2-e749-4b38-8812-e9d4df591f41"}, {"server_uuid": "94a8f46d-3105-4486-a8b4-1409c9c544c7", "name": "network-vif-plugged", "status": "completed", "tag": "ac8aece2-e749-4b38-8812-e9d4df591f41"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Creating event network-changed:61814597-e5ae-41b8-9cfb-2de8d8f596ef for instance 317be079-9b77-4139-88a4-36efb848c025 on user Nov 28 06:40:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Creating event network-vif-plugged:ac8aece2-e749-4b38-8812-e9d4df591f41 for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 on user Nov 28 06:40:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] Creating event network-vif-plugged:ac8aece2-e749-4b38-8812-e9d4df591f41 for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 on user Nov 28 06:40:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-e7cdc462-b791-4d2e-b58a-dcb9df5e86a3 req-84bcb6bf-55b8-41dc-9158-1483a2aa47b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.051489 Nov 28 06:40:09 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 46/130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:09 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:40:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b75c4d9c-4b49-4059-863b-daee51ae44af tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.161526 Nov 28 06:40:09 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 44/131] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:40:09 2023] GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/os-interface => generated 283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:09 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-797277048", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "key_name": "tempest-TestStampPattern-1173073735", "security_groups": [{"name": "tempest-secgroup-smoke-222083240"}], "networks": [{"uuid": "a116c7b1-1d5c-4fc1-8589-714e935c8b89"}]}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:09 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] validate_networks() for [('a116c7b1-1d5c-4fc1-8589-714e935c8b89', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:40:09 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:10 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:10 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:10 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-78604908-4c27-4502-838b-7a33ac3eba98 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee" status: 200 len: 2820 microversion: 2.32 time: 0.774256 Nov 28 06:40:10 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 42/132] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:40:09 2023] GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee => generated 2820 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Getting quotas for project 48cff8da56da484d9dfee1b8118474b9. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Getting quotas for user 73373ee05e1b4e09b5c0870750a77262 and project 48cff8da56da484d9dfee1b8118474b9. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:40:10 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:40:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e572fa5b-991a-49a7-9b06-9d7cd6dbaa51 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.754597 Nov 28 06:40:10 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 47/133] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:40:09 2023] POST /compute/v2.1/servers => generated 403 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:40:10 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b7df634e-1891-43f5-a4ba-92c59bdf05a6 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:10 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-b7df634e-1891-43f5-a4ba-92c59bdf05a6 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:10 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-b7df634e-1891-43f5-a4ba-92c59bdf05a6 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73373ee05e1b4e09b5c0870750a77262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cff8da56da484d9dfee1b8118474b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:10 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b7df634e-1891-43f5-a4ba-92c59bdf05a6 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" status: 200 len: 1234 microversion: 2.1 time: 0.086858 Nov 28 06:40:10 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 45/134] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:40:10 2023] GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 => generated 1234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:40:10 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-4fcc6ca1-5a37-41d5-a86a-5f722df378ba tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:10 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-4fcc6ca1-5a37-41d5-a86a-5f722df378ba tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4fcc6ca1-5a37-41d5-a86a-5f722df378ba tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4fcc6ca1-5a37-41d5-a86a-5f722df378ba tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4fcc6ca1-5a37-41d5-a86a-5f722df378ba tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4fcc6ca1-5a37-41d5-a86a-5f722df378ba tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4fcc6ca1-5a37-41d5-a86a-5f722df378ba tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4fcc6ca1-5a37-41d5-a86a-5f722df378ba tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:11 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-4fcc6ca1-5a37-41d5-a86a-5f722df378ba tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.322839 Nov 28 06:40:11 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 43/135] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:40:10 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7/os-interface => generated 282 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:11 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317be079-9b77-4139-88a4-36efb848c025", "name": "network-vif-plugged", "status": "completed", "tag": "61814597-e5ae-41b8-9cfb-2de8d8f596ef"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:11 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] Creating event network-vif-plugged:61814597-e5ae-41b8-9cfb-2de8d8f596ef for instance 317be079-9b77-4139-88a4-36efb848c025 on user Nov 28 06:40:11 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-b71e31a2-240a-44c8-9344-e50f6c5add0d req-44103de7-7182-4443-aa16-c4a14405c25e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034656 Nov 28 06:40:11 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 48/136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:11 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-025b5b5b-67e3-4fb6-b51f-cb29e898cce1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:11 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-025b5b5b-67e3-4fb6-b51f-cb29e898cce1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-025b5b5b-67e3-4fb6-b51f-cb29e898cce1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-025b5b5b-67e3-4fb6-b51f-cb29e898cce1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-025b5b5b-67e3-4fb6-b51f-cb29e898cce1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-025b5b5b-67e3-4fb6-b51f-cb29e898cce1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-025b5b5b-67e3-4fb6-b51f-cb29e898cce1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-025b5b5b-67e3-4fb6-b51f-cb29e898cce1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:11 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-025b5b5b-67e3-4fb6-b51f-cb29e898cce1 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/ips" status: 200 len: 109 microversion: 2.1 time: 0.063394 Nov 28 06:40:11 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 46/137] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:40:11 2023] GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/ips => generated 109 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] Creating event network-changed:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:40:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-bfa787ad-9baa-4154-991e-4d31635f67f7 req-059a20a2-3958-4b47-b8d2-0d693464b072 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033722 Nov 28 06:40:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 44/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:12 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c959f8b1-cde2-4385-ae53-14f25b318d10 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:12 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-c959f8b1-cde2-4385-ae53-14f25b318d10 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c959f8b1-cde2-4385-ae53-14f25b318d10 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c959f8b1-cde2-4385-ae53-14f25b318d10 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c959f8b1-cde2-4385-ae53-14f25b318d10 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c959f8b1-cde2-4385-ae53-14f25b318d10 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c959f8b1-cde2-4385-ae53-14f25b318d10 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c959f8b1-cde2-4385-ae53-14f25b318d10 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:12 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-c959f8b1-cde2-4385-ae53-14f25b318d10 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:12 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-c959f8b1-cde2-4385-ae53-14f25b318d10 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1540 microversion: 2.1 time: 0.443982 Nov 28 06:40:12 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 49/139] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:40:12 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1540 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:40:12 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-7b27116f-c530-4db0-8b5d-b283d33a7170 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:12 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-7b27116f-c530-4db0-8b5d-b283d33a7170 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b27116f-c530-4db0-8b5d-b283d33a7170 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b27116f-c530-4db0-8b5d-b283d33a7170 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b27116f-c530-4db0-8b5d-b283d33a7170 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b27116f-c530-4db0-8b5d-b283d33a7170 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b27116f-c530-4db0-8b5d-b283d33a7170 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b27116f-c530-4db0-8b5d-b283d33a7170 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:13 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4802806-6422-46da-8d0f-5674af0a8433", "tag": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a"}, {"server_uuid": "317be079-9b77-4139-88a4-36efb848c025", "name": "network-vif-plugged", "status": "completed", "tag": "61814597-e5ae-41b8-9cfb-2de8d8f596ef"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:13 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Creating event network-changed:1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance b4802806-6422-46da-8d0f-5674af0a8433 on user Nov 28 06:40:13 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] Creating event network-vif-plugged:61814597-e5ae-41b8-9cfb-2de8d8f596ef for instance 317be079-9b77-4139-88a4-36efb848c025 on user Nov 28 06:40:13 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-1990692c-03ce-4a7d-97fa-d3897d16697b req-9751736e-28ab-4ca5-ad00-b50d839a1c00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064740 Nov 28 06:40:13 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 45/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:13 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:13 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-7b27116f-c530-4db0-8b5d-b283d33a7170 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-7b27116f-c530-4db0-8b5d-b283d33a7170 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1540 microversion: 2.1 time: 0.397482 Nov 28 06:40:13 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 47/141] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:40:12 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1540 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:40:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:14 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1900fa23-0a3f-410b-950f-926a0e9fa93f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539645 Nov 28 06:40:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 50/142] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:40:14 2023] POST /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:15 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5", "tag": "3910f97d-105a-4142-a3ab-effc57185190"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:15 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] Creating event network-changed:3910f97d-105a-4142-a3ab-effc57185190 for instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 on user Nov 28 06:40:15 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-47fa1f6e-e74b-45f4-b644-5e777fd3d1e7 req-29cb44c2-8110-4bcf-b068-fb07e7e3910c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037566 Nov 28 06:40:15 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 46/143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:15 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:15 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:16 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:16 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:16 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-099551d1-f8a1-4ff0-a049-245744babbb5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62" status: 200 len: 1692 microversion: 2.87 time: 0.612279 Nov 28 06:40:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 48/144] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:40:15 2023] GET /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62 => generated 1692 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:40:16 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-15d21f81-6323-4462-ae51-6a02a62256c5 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:16 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-15d21f81-6323-4462-ae51-6a02a62256c5 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-15d21f81-6323-4462-ae51-6a02a62256c5 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-15d21f81-6323-4462-ae51-6a02a62256c5 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-15d21f81-6323-4462-ae51-6a02a62256c5 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-15d21f81-6323-4462-ae51-6a02a62256c5 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-15d21f81-6323-4462-ae51-6a02a62256c5 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-15d21f81-6323-4462-ae51-6a02a62256c5 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-15d21f81-6323-4462-ae51-6a02a62256c5 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.191091 Nov 28 06:40:16 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 51/145] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:40:16 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-interface => generated 282 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5", "name": "network-vif-plugged", "status": "completed", "tag": "3910f97d-105a-4142-a3ab-effc57185190"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] Creating event network-vif-plugged:3910f97d-105a-4142-a3ab-effc57185190 for instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 on user Nov 28 06:40:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-940e19d4-d917-46da-acff-bc96253b9f25 req-00b6dcd0-0c87-464b-9d59-3e96058a5e8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065801 Nov 28 06:40:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 47/146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:19 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1135161182"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:19 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:19 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5", "name": "network-vif-plugged", "status": "completed", "tag": "3910f97d-105a-4142-a3ab-effc57185190"}, {"name": "network-changed", "server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:19 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:19 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:19 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:19 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Creating event network-vif-plugged:3910f97d-105a-4142-a3ab-effc57185190 for instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 on user Nov 28 06:40:19 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] Creating event network-changed:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:40:19 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-ec2c430a-f6ea-4715-ab59-896a8d3f3756 req-16ac5b88-c5bb-47a9-a1df-6d0502921095 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077322 Nov 28 06:40:19 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 52/147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:19 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:20 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=8 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-cec99da9-e2e9-4eb4-885e-cb4bbfb27978 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/action" status: 202 len: 0 microversion: 2.1 time: 1.542986 Nov 28 06:40:20 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 49/148] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:40:19 2023] POST /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/action => generated 0 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 06:40:20 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-99ec82d9-b3d8-4707-ba46-2ab7db6ac5f3 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '.version_select at 0x7f0b03fa1120>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-99ec82d9-b3d8-4707-ba46-2ab7db6ac5f3 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/images/f40204eb-15d5-4f6d-a086-d9654a71267f" status: 200 len: 1611 microversion: 2.1 time: 0.076084 Nov 28 06:40:20 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 48/149] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 06:40:20 2023] GET /compute/v2.1/images/f40204eb-15d5-4f6d-a086-d9654a71267f => generated 1611 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:40:27 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:27 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=12 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a207b211-6a12-40a0-91d2-e51585179537 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: .version_select at 0x7f0b03d4dbd0>, body: {"keypair": {"name": "tempest-keypair-1335441825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoHWATyOznTa3QISkPxYic5CYo5gMvAHv39uglMQOy4R4C3vYAKpZGMik0+X0Bvm/kPlXlGSrDPHEXQdQpRBI9+0O95dTnBB1+GuFPUbKtFKHp29bFKjhno/xwR6OeWhA=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:27 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-a207b211-6a12-40a0-91d2-e51585179537 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for project 5df9ec769206481e8dad48a6461c46ba. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:40:27 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-a207b211-6a12-40a0-91d2-e51585179537 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for user 05e396090c4b4a8995d8d2e66c8b3db0 and project 5df9ec769206481e8dad48a6461c46ba. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:40:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a207b211-6a12-40a0-91d2-e51585179537 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049445 Nov 28 06:40:27 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 53/150] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:40:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:28 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-184058363", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "202f7756-ce64-4307-8a6b-b7601305e6b7"}], "security_groups": [{"name": "tempest-securitygroup--1601194179"}], "key_name": "tempest-keypair-1335441825", "user_data": "}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] validate_networks() for [('202f7756-ce64-4307-8a6b-b7601305e6b7', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for project 5df9ec769206481e8dad48a6461c46ba. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for user 05e396090c4b4a8995d8d2e66c8b3db0 and project 5df9ec769206481e8dad48a6461c46ba. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:40:29 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:40:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-1fe32cc3-17de-42cf-a37b-1e74368588eb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.715917 Nov 28 06:40:29 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 50/151] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:40:28 2023] POST /compute/v2.1/servers => generated 400 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:40:29 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=26 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:29 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=38 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:29 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-638aeb31-8078-4311-9a1d-82eb19306560 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:29 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-638aeb31-8078-4311-9a1d-82eb19306560 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:29 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-638aeb31-8078-4311-9a1d-82eb19306560 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-638aeb31-8078-4311-9a1d-82eb19306560 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386" status: 200 len: 1233 microversion: 2.1 time: 0.189944 Nov 28 06:40:29 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 49/152] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:40:29 2023] GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386 => generated 1233 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:40:31 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:31 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d55efc7f-0fbb-4f6c-bbd7-4467fbfdecd4 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:31 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d55efc7f-0fbb-4f6c-bbd7-4467fbfdecd4 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d55efc7f-0fbb-4f6c-bbd7-4467fbfdecd4 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d55efc7f-0fbb-4f6c-bbd7-4467fbfdecd4 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d55efc7f-0fbb-4f6c-bbd7-4467fbfdecd4 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d55efc7f-0fbb-4f6c-bbd7-4467fbfdecd4 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d55efc7f-0fbb-4f6c-bbd7-4467fbfdecd4 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d55efc7f-0fbb-4f6c-bbd7-4467fbfdecd4 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d55efc7f-0fbb-4f6c-bbd7-4467fbfdecd4 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.201669 Nov 28 06:40:31 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 54/153] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:40:31 2023] GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-interface => generated 282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:32 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636fad3b-617f-4a65-8cf7-ef67fd68304b", "tag": "519d15c3-a87c-436b-aa7d-b6754a055382"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] Creating event network-changed:519d15c3-a87c-436b-aa7d-b6754a055382 for instance 636fad3b-617f-4a65-8cf7-ef67fd68304b on user Nov 28 06:40:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-10add5f7-e3f3-46b5-b8e9-dee250078e0c req-a53c109b-9fd5-4867-a0d1-78c433f8a01b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035344 Nov 28 06:40:32 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 51/154] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:32 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30131e3-a805-4fbc-815c-7e379c44a386", "tag": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:32 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] Creating event network-changed:8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance b30131e3-a805-4fbc-815c-7e379c44a386 on user Nov 28 06:40:32 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-ea934fa1-001c-4b4a-8ac6-67cfb3fcbee8 req-2e07d7df-f0f6-40a9-82f0-f71993ef4ab5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050220 Nov 28 06:40:32 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 50/155] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:34 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a7285f6-0c7b-4de0-a44d-fc22c9226685"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:34 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:35 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30131e3-a805-4fbc-815c-7e379c44a386", "name": "network-vif-plugged", "status": "completed", "tag": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:35 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] Creating event network-vif-plugged:8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance b30131e3-a805-4fbc-815c-7e379c44a386 on user Nov 28 06:40:35 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-e6f64421-c5a6-4dcb-a4d8-cce207c62108 req-b75b21cc-f26a-46c7-97dc-42f46c2dd0f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029088 Nov 28 06:40:35 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 52/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d36edbf0-3acf-432c-827f-ebb32b441d3a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350697 Nov 28 06:40:35 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 55/157] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:40:34 2023] POST /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:37 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30131e3-a805-4fbc-815c-7e379c44a386", "name": "network-vif-plugged", "status": "completed", "tag": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:37 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] Creating event network-vif-plugged:8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance b30131e3-a805-4fbc-815c-7e379c44a386 on user Nov 28 06:40:37 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-a3fcda32-c20b-4320-b8a9-f4ec1ddc5344 req-3c94c2fb-ba43-49c9-ac5e-df9163d029f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028398 Nov 28 06:40:37 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 51/158] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:39 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:39 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:39 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9a29dc2b-5b8a-444c-96e7-96d0b5a19887 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:39 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-9a29dc2b-5b8a-444c-96e7-96d0b5a19887 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9a29dc2b-5b8a-444c-96e7-96d0b5a19887 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9a29dc2b-5b8a-444c-96e7-96d0b5a19887 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9a29dc2b-5b8a-444c-96e7-96d0b5a19887 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9a29dc2b-5b8a-444c-96e7-96d0b5a19887 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9a29dc2b-5b8a-444c-96e7-96d0b5a19887 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9a29dc2b-5b8a-444c-96e7-96d0b5a19887 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:39 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9a29dc2b-5b8a-444c-96e7-96d0b5a19887 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.150734 Nov 28 06:40:39 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 53/159] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:40:39 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-interface => generated 282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c94c69-4907-404d-ad02-d8ba2716a4e7", "tag": "affac6e2-50a7-44d2-b7ba-ec18341bb71f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:40 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] Creating event network-changed:affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 on user Nov 28 06:40:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-8c3b0b55-ef1e-4167-99f2-bec0874ea761 req-bec6112c-fb26-46f3-88e1-5cc9bd31a3d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039783 Nov 28 06:40:40 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 56/160] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:40 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:40 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6b27c97-e46a-41e7-8096-86cbe43a8b11"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:40 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6b4c1a6c-31e0-429e-aac1-11218ee874e8 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "POST /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308252 Nov 28 06:40:40 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 52/161] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:40:40 2023] POST /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:44 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-df73ad28-827a-4524-93ba-66dcb95bf539 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:44 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-df73ad28-827a-4524-93ba-66dcb95bf539 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-df73ad28-827a-4524-93ba-66dcb95bf539 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-df73ad28-827a-4524-93ba-66dcb95bf539 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-df73ad28-827a-4524-93ba-66dcb95bf539 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-df73ad28-827a-4524-93ba-66dcb95bf539 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-df73ad28-827a-4524-93ba-66dcb95bf539 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-df73ad28-827a-4524-93ba-66dcb95bf539 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:44 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-df73ad28-827a-4524-93ba-66dcb95bf539 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.134765 Nov 28 06:40:44 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 54/162] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:40:44 2023] GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00/os-interface => generated 283 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:45 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3406c2b-4e6e-4be0-b84a-168c59322f00", "tag": "44cb2e46-5eae-4728-ac61-29177ecb06f6"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:45 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] Creating event network-changed:44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance e3406c2b-4e6e-4be0-b84a-168c59322f00 on user Nov 28 06:40:45 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-f0119a74-8d5b-42cd-b51b-7a596d0f40c6 req-cbc41959-ec32-40d2-8972-720587fbf5b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032310 Nov 28 06:40:45 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 57/163] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:40:45 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:45 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-228b1718-bea9-4b75-8f90-aead67e3da25 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] 10.0.0.210 "POST /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484928 Nov 28 06:40:46 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 53/164] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:40:45 2023] POST /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f70ee4ae-95c2-4f6a-a6ea-99c1da2433cb"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:46 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] HTTP exception thrown: Volume f70ee4ae-95c2-4f6a-a6ea-99c1da2433cb could not be found. Nov 28 06:40:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Returning 400 to user: Volume f70ee4ae-95c2-4f6a-a6ea-99c1da2433cb could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:40:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d1055c08-d4f1-4631-be74-8aa0759d94db tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-volume_attachments/0a7285f6-0c7b-4de0-a44d-fc22c9226685" status: 400 len: 107 microversion: 2.1 time: 0.321062 Nov 28 06:40:46 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 55/165] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 06:40:46 2023] PUT /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-volume_attachments/0a7285f6-0c7b-4de0-a44d-fc22c9226685 => generated 107 bytes in 322 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:40:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:46 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:46 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lazy-loading 'services' on Instance uuid 636fad3b-617f-4a65-8cf7-ef67fd68304b {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:40:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-832b339b-6fa9-41cb-9f85-ff7c3090104a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-volume_attachments/0a7285f6-0c7b-4de0-a44d-fc22c9226685" status: 202 len: 0 microversion: 2.1 time: 0.288329 Nov 28 06:40:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 58/166] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:40:46 2023] DELETE /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-volume_attachments/0a7285f6-0c7b-4de0-a44d-fc22c9226685 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:40:46 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-210c2953-e4d0-4501-9f6c-d809d99a8886 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:46 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-210c2953-e4d0-4501-9f6c-d809d99a8886 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-210c2953-e4d0-4501-9f6c-d809d99a8886 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-210c2953-e4d0-4501-9f6c-d809d99a8886 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-210c2953-e4d0-4501-9f6c-d809d99a8886 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-210c2953-e4d0-4501-9f6c-d809d99a8886 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-210c2953-e4d0-4501-9f6c-d809d99a8886 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-210c2953-e4d0-4501-9f6c-d809d99a8886 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-210c2953-e4d0-4501-9f6c-d809d99a8886 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050774 Nov 28 06:40:46 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 54/167] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:40:46 2023] GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a60faa57-ed99-4b91-933b-a8f84da07af0"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:50 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ab1bf912-d598-4e80-bdac-beb94071f76e tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments/d6b27c97-e46a-41e7-8096-86cbe43a8b11" status: 202 len: 0 microversion: 2.1 time: 0.439154 Nov 28 06:40:50 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 56/168] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 06:40:50 2023] PUT /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments/d6b27c97-e46a-41e7-8096-86cbe43a8b11 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:40:51 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-02ba63a9-1514-4b07-8ccb-05649fb51808 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:51 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-02ba63a9-1514-4b07-8ccb-05649fb51808 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02ba63a9-1514-4b07-8ccb-05649fb51808 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02ba63a9-1514-4b07-8ccb-05649fb51808 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02ba63a9-1514-4b07-8ccb-05649fb51808 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02ba63a9-1514-4b07-8ccb-05649fb51808 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02ba63a9-1514-4b07-8ccb-05649fb51808 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02ba63a9-1514-4b07-8ccb-05649fb51808 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:51 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-02ba63a9-1514-4b07-8ccb-05649fb51808 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079/os-interface" status: 200 len: 295 microversion: 2.93 time: 0.183660 Nov 28 06:40:51 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 59/169] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 06:40:51 2023] GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079/os-interface => generated 295 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:52 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] Creating event network-changed:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:40:52 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-08dd6259-605c-44ae-a416-c0c7ddb3aea4 req-d6bce2ba-d424-46fb-8f75-563f8b92bf3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031855 Nov 28 06:40:52 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 57/170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:52 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-7affa862-1859-4ff4-9e6d-ebb18911a2f1 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079" status: 200 len: 1721 microversion: 2.93 time: 0.288059 Nov 28 06:40:52 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 55/171] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:40:52 2023] GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079 => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:40:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsV293TestJSON-server-1780739755", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:52 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting quotas for project ff4ac048770a4680a35f71465d191d49. Resources: dict_keys(['metadata_items']) {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Getting quotas for user 48e7c51916684bec98970a963f2c560e and project ff4ac048770a4680a35f71465d191d49. Resources: dict_keys(['metadata_items']) {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:53 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "POST /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079/action" status: 202 len: 2044 microversion: 2.93 time: 0.674819 Nov 28 06:40:53 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 60/172] 10.0.0.210 () {66 vars in 1397 bytes} [Tue Nov 28 06:40:52 2023] POST /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079/action => generated 2044 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 28 06:40:53 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-26344786-b743-476b-be84-82a323a0c438 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-26344786-b743-476b-be84-82a323a0c438 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 423 microversion: 2.93 time: 0.019228 Nov 28 06:40:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 58/173] 10.0.0.210 () {64 vars in 1249 bytes} [Tue Nov 28 06:40:53 2023] GET /compute/v2.1/flavors/1 => generated 423 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:53 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:53 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c54bc98c-57f8-4983-9d27-d4280f6f92c4 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079" status: 200 len: 1867 microversion: 2.93 time: 0.258166 Nov 28 06:40:53 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 56/174] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:40:53 2023] GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079 => generated 1867 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:40:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "name": "network-vif-unplugged", "status": "completed", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:54 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] Creating event network-vif-unplugged:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:40:54 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-27694433-ac7b-4217-a003-2d9a1d2a8e5d req-ebb0275c-aca5-42a9-99e6-53d4a3c0db0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029376 Nov 28 06:40:54 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 61/175] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b7f1399c-08dd-4d80-a5bf-c4364452cf86 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:54 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-b7f1399c-08dd-4d80-a5bf-c4364452cf86 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7f1399c-08dd-4d80-a5bf-c4364452cf86 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7f1399c-08dd-4d80-a5bf-c4364452cf86 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7f1399c-08dd-4d80-a5bf-c4364452cf86 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7f1399c-08dd-4d80-a5bf-c4364452cf86 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7f1399c-08dd-4d80-a5bf-c4364452cf86 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7f1399c-08dd-4d80-a5bf-c4364452cf86 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:54 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-b7f1399c-08dd-4d80-a5bf-c4364452cf86 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b7f1399c-08dd-4d80-a5bf-c4364452cf86 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7" status: 200 len: 1486 microversion: 2.1 time: 0.250228 Nov 28 06:40:54 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 59/176] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:40:54 2023] GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7 => generated 1486 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:40:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8df8e36b-17b0-4a8b-8ab2-ac18be7980a7 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:55 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8df8e36b-17b0-4a8b-8ab2-ac18be7980a7 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8df8e36b-17b0-4a8b-8ab2-ac18be7980a7 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8df8e36b-17b0-4a8b-8ab2-ac18be7980a7 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8df8e36b-17b0-4a8b-8ab2-ac18be7980a7 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8df8e36b-17b0-4a8b-8ab2-ac18be7980a7 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8df8e36b-17b0-4a8b-8ab2-ac18be7980a7 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8df8e36b-17b0-4a8b-8ab2-ac18be7980a7 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:55 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-8df8e36b-17b0-4a8b-8ab2-ac18be7980a7 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:40:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-8df8e36b-17b0-4a8b-8ab2-ac18be7980a7 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025" status: 200 len: 1491 microversion: 2.1 time: 0.199930 Nov 28 06:40:55 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 57/177] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:40:55 2023] GET /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025 => generated 1491 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:40:56 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "name": "network-vif-plugged", "status": "completed", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] Creating event network-vif-plugged:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:40:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-035c7d26-15a5-4967-844a-e2cd22ce6ed3 req-be65bc46-3ce7-495c-87ce-6d726f60844c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032678 Nov 28 06:40:56 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 62/178] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:40:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1", "create_info": {"snapshot_id": "1825bcbe-1f09-4f29-bb6e-ceaa81c66152", "type": "qcow2", "new_file": "new_file"}}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27e7b418-6c10-4d08-8a14-ffd74894eb19(cell1) {{(pid=64871) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-08b8b153-a51e-447f-9519-e5177237c22d tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] 10.0.0.210 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.198048 Nov 28 06:40:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 60/179] 10.0.0.210 () {64 vars in 1287 bytes} [Tue Nov 28 06:40:57 2023] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:40:57 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:57 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27e7b418-6c10-4d08-8a14-ffd74894eb19(cell1) {{(pid=64873) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 28 06:40:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:57 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6c1a9a9f-6047-4dab-86f0-7f72c9ec95f7 tempest-VolumesAssistedSnapshotsTest-2070839116 tempest-VolumesAssistedSnapshotsTest-2070839116-project] 10.0.0.210 "DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%2266fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.074087 Nov 28 06:40:57 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 58/180] 10.0.0.210 () {62 vars in 1442 bytes} [Tue Nov 28 06:40:57 2023] DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%2266fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1%22%7D => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:40:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:57 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:57 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lazy-loading 'services' on Instance uuid e3406c2b-4e6e-4be0-b84a-168c59322f00 {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:40:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-3f21415c-0eaf-481a-984c-7791f62bde90 tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] 10.0.0.210 "DELETE /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00/os-volume_attachments/66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1" status: 202 len: 0 microversion: 2.1 time: 0.279906 Nov 28 06:40:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 63/181] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:40:57 2023] DELETE /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00/os-volume_attachments/66fb3ef8-3b0e-4271-9f6a-2ea56c4ef6e1 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e41ec3a7-56fe-40d1-a6ef-bf741a2fa78b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e41ec3a7-56fe-40d1-a6ef-bf741a2fa78b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e41ec3a7-56fe-40d1-a6ef-bf741a2fa78b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e41ec3a7-56fe-40d1-a6ef-bf741a2fa78b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e41ec3a7-56fe-40d1-a6ef-bf741a2fa78b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e41ec3a7-56fe-40d1-a6ef-bf741a2fa78b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e41ec3a7-56fe-40d1-a6ef-bf741a2fa78b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e41ec3a7-56fe-40d1-a6ef-bf741a2fa78b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:40:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:40:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e41ec3a7-56fe-40d1-a6ef-bf741a2fa78b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059203 Nov 28 06:40:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:40:57 2023] GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:00 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-3617d234-637f-49a8-8ea7-430491348a81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:00 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-3617d234-637f-49a8-8ea7-430491348a81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3617d234-637f-49a8-8ea7-430491348a81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3617d234-637f-49a8-8ea7-430491348a81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3617d234-637f-49a8-8ea7-430491348a81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3617d234-637f-49a8-8ea7-430491348a81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3617d234-637f-49a8-8ea7-430491348a81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3617d234-637f-49a8-8ea7-430491348a81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:00 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-3617d234-637f-49a8-8ea7-430491348a81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73373ee05e1b4e09b5c0870750a77262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cff8da56da484d9dfee1b8118474b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-3617d234-637f-49a8-8ea7-430491348a81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" status: 200 len: 1535 microversion: 2.1 time: 0.228209 Nov 28 06:41:00 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 59/183] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:41:00 2023] GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 => generated 1535 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:41:03 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b86bc461-b621-4912-88f3-82f0db778bca tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:03 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-b86bc461-b621-4912-88f3-82f0db778bca tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:03 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b86bc461-b621-4912-88f3-82f0db778bca tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b86bc461-b621-4912-88f3-82f0db778bca tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b86bc461-b621-4912-88f3-82f0db778bca tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b86bc461-b621-4912-88f3-82f0db778bca tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b86bc461-b621-4912-88f3-82f0db778bca tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b86bc461-b621-4912-88f3-82f0db778bca tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:03 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-b86bc461-b621-4912-88f3-82f0db778bca tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:03 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b86bc461-b621-4912-88f3-82f0db778bca tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1658 microversion: 2.1 time: 0.276969 Nov 28 06:41:03 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 64/184] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:41:03 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1658 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:41:03 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-25310d2d-3e1a-4065-8737-7d2eef540249 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:03 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-25310d2d-3e1a-4065-8737-7d2eef540249 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-25310d2d-3e1a-4065-8737-7d2eef540249 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-25310d2d-3e1a-4065-8737-7d2eef540249 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-25310d2d-3e1a-4065-8737-7d2eef540249 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-25310d2d-3e1a-4065-8737-7d2eef540249 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-25310d2d-3e1a-4065-8737-7d2eef540249 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-25310d2d-3e1a-4065-8737-7d2eef540249 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:03 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-25310d2d-3e1a-4065-8737-7d2eef540249 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:03 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-25310d2d-3e1a-4065-8737-7d2eef540249 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1658 microversion: 2.1 time: 0.259649 Nov 28 06:41:03 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:41:03 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1658 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:41:07 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d28007c3-a29d-4ac0-b41e-e72fa2e6dd85 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:07 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d28007c3-a29d-4ac0-b41e-e72fa2e6dd85 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:07 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d28007c3-a29d-4ac0-b41e-e72fa2e6dd85 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d28007c3-a29d-4ac0-b41e-e72fa2e6dd85 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d28007c3-a29d-4ac0-b41e-e72fa2e6dd85 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d28007c3-a29d-4ac0-b41e-e72fa2e6dd85 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d28007c3-a29d-4ac0-b41e-e72fa2e6dd85 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d28007c3-a29d-4ac0-b41e-e72fa2e6dd85 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:07 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d28007c3-a29d-4ac0-b41e-e72fa2e6dd85 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047032 Nov 28 06:41:07 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 60/186] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:41:07 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:07 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-57b2b69e-147c-48e4-957c-309089a7bac2 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:07 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-57b2b69e-147c-48e4-957c-309089a7bac2 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57b2b69e-147c-48e4-957c-309089a7bac2 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57b2b69e-147c-48e4-957c-309089a7bac2 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57b2b69e-147c-48e4-957c-309089a7bac2 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57b2b69e-147c-48e4-957c-309089a7bac2 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57b2b69e-147c-48e4-957c-309089a7bac2 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57b2b69e-147c-48e4-957c-309089a7bac2 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:07 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-57b2b69e-147c-48e4-957c-309089a7bac2 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041189 Nov 28 06:41:07 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 65/187] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:41:07 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:07 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d6b27c97-e46a-41e7-8096-86cbe43a8b11"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:07 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:07 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:07 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-fec5f09d-20f5-4dfa-811c-0cdafbfe3679 tempest-TestVolumeSwap-840955041 tempest-TestVolumeSwap-840955041-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments/a60faa57-ed99-4b91-933b-a8f84da07af0" status: 202 len: 0 microversion: 2.1 time: 0.498980 Nov 28 06:41:07 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 63/188] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 06:41:07 2023] PUT /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments/a60faa57-ed99-4b91-933b-a8f84da07af0 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:41:10 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-230f9614-0df4-40bd-a8a1-3afee50cb476 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:10 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-230f9614-0df4-40bd-a8a1-3afee50cb476 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-230f9614-0df4-40bd-a8a1-3afee50cb476 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-230f9614-0df4-40bd-a8a1-3afee50cb476 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-230f9614-0df4-40bd-a8a1-3afee50cb476 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-230f9614-0df4-40bd-a8a1-3afee50cb476 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-230f9614-0df4-40bd-a8a1-3afee50cb476 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-230f9614-0df4-40bd-a8a1-3afee50cb476 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:10 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-230f9614-0df4-40bd-a8a1-3afee50cb476 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.342692 Nov 28 06:41:10 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 61/189] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 06:41:10 2023] GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee/os-interface => generated 1828 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:41:10 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4d9f3ce1-9888-49e8-a245-ab67d8d42665 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '.version_select at 0x7f0b03cda9e0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:11 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4d9f3ce1-9888-49e8-a245-ab67d8d42665 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/images/f40204eb-15d5-4f6d-a086-d9654a71267f" status: 200 len: 1725 microversion: 2.1 time: 0.257105 Nov 28 06:41:11 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 66/190] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 06:41:10 2023] GET /compute/v2.1/images/f40204eb-15d5-4f6d-a086-d9654a71267f => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:41:11 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6ac7a5e3-7fdd-4d33-a185-7ca671190f78 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '.version_select at 0x7f0b03c42050>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "tag": "1c17febf-a6ee-4954-9d0c-f6282ae774ea"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:11 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] Creating event network-changed:1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:11 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-297c443f-de8b-49d9-8888-904deb274219 req-4cb36e6c-81a2-4f77-81d5-ee5aa6c217cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042140 Nov 28 06:41:11 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 62/191] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:11 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6ac7a5e3-7fdd-4d33-a185-7ca671190f78 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/images/f40204eb-15d5-4f6d-a086-d9654a71267f" status: 200 len: 1725 microversion: 2.1 time: 0.316231 Nov 28 06:41:11 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 06:41:11 2023] GET /compute/v2.1/images/f40204eb-15d5-4f6d-a086-d9654a71267f => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e6d41cd8-445f-4d02-9982-4548098770f8 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e6d41cd8-445f-4d02-9982-4548098770f8 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6d41cd8-445f-4d02-9982-4548098770f8 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6d41cd8-445f-4d02-9982-4548098770f8 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6d41cd8-445f-4d02-9982-4548098770f8 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6d41cd8-445f-4d02-9982-4548098770f8 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6d41cd8-445f-4d02-9982-4548098770f8 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6d41cd8-445f-4d02-9982-4548098770f8 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:11 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-e6d41cd8-445f-4d02-9982-4548098770f8 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f53e7a2f95545d196a5b2d36ef6d692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30dc21619f949b18be9362b217e7c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:11 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e6d41cd8-445f-4d02-9982-4548098770f8 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620" status: 200 len: 1667 microversion: 2.1 time: 0.214297 Nov 28 06:41:11 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 63/193] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:41:11 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620 => generated 1667 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:11 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:11 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-c8985fd3-6b63-43af-be2e-a50140b0c550 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee" status: 200 len: 2820 microversion: 2.32 time: 0.488403 Nov 28 06:41:11 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 67/194] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:41:11 2023] GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee => generated 2820 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:41:11 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-7b617c84-5b0f-4630-a50c-7e1123edf890 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:11 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-7b617c84-5b0f-4630-a50c-7e1123edf890 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b617c84-5b0f-4630-a50c-7e1123edf890 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b617c84-5b0f-4630-a50c-7e1123edf890 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b617c84-5b0f-4630-a50c-7e1123edf890 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b617c84-5b0f-4630-a50c-7e1123edf890 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b617c84-5b0f-4630-a50c-7e1123edf890 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7b617c84-5b0f-4630-a50c-7e1123edf890 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:12 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-7b617c84-5b0f-4630-a50c-7e1123edf890 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.339904 Nov 28 06:41:12 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 65/195] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 06:41:11 2023] GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee/os-interface => generated 1828 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:41:13 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:13 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:13 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:41:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d5f1eef1-5f2a-4844-aa1b-33336f7581e2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee" status: 204 len: 0 microversion: 2.32 time: 0.181761 Nov 28 06:41:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 64/196] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:41:13 2023] DELETE /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58a9aacbcb174f658f3cbba2e84d6e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49de64e4ec95433297cb192cadd60402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-5b9a3e9f-27ba-4933-b58d-446e890cfcdf tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee" status: 200 len: 2945 microversion: 2.32 time: 0.362633 Nov 28 06:41:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 68/197] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:41:14 2023] GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee => generated 2945 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:41:14 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-unplugged", "status": "completed", "tag": "1c17febf-a6ee-4954-9d0c-f6282ae774ea"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:14 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] Creating event network-vif-unplugged:1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:14 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-da50aa52-d81a-45e0-a16c-1e3a9aa2b347 req-be46a1d8-a9fe-488f-adc9-029c3fc3b64d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032278 Nov 28 06:41:14 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 66/198] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:14 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-unplugged", "status": "completed", "tag": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] Creating event network-vif-unplugged:cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e628fd10-2b0c-48b5-aa6a-9cf296ddecce req-a6a556f2-bb94-48bb-8469-73c6c08a64f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034468 Nov 28 06:41:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 65/199] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-unplugged", "status": "completed", "tag": "97c7e28d-01ae-4b01-8594-2e507f37eeb7"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] Creating event network-vif-unplugged:97c7e28d-01ae-4b01-8594-2e507f37eeb7 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-913d8087-23d9-48bf-a257-10a1d735c60d req-51d14afe-c967-43a7-81dd-07d4ea9a5cc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042240 Nov 28 06:41:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 69/200] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1924475466", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "7bc73412-fe34-4d8c-85c8-4cc726512d5e"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] validate_networks() for [('7bc73412-fe34-4d8c-85c8-4cc726512d5e', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:41:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "1c17febf-a6ee-4954-9d0c-f6282ae774ea"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-unplugged", "status": "completed", "tag": "b1021f35-3b88-4288-818c-325753086daf"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "b1021f35-3b88-4288-818c-325753086daf"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-unplugged", "status": "completed", "tag": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Creating event network-vif-plugged:1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Creating event network-vif-unplugged:b1021f35-3b88-4288-818c-325753086daf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Creating event network-vif-plugged:b1021f35-3b88-4288-818c-325753086daf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Creating event network-vif-unplugged:7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] Creating event network-vif-plugged:7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e92ae0a0-0e68-47eb-8058-956f79984138 req-69deecea-0954-40b7-b757-630287c81a62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.035165 Nov 28 06:41:16 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 66/201] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:16 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:16 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "cf5914b8-0656-47c2-ba2c-2fe6d04a6a65"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-unplugged", "status": "completed", "tag": "a7a63db6-53d0-4e2f-acad-d649701a3f90"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "a7a63db6-53d0-4e2f-acad-d649701a3f90"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Creating event network-vif-plugged:cf5914b8-0656-47c2-ba2c-2fe6d04a6a65 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Creating event network-vif-unplugged:a7a63db6-53d0-4e2f-acad-d649701a3f90 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] Creating event network-vif-plugged:a7a63db6-53d0-4e2f-acad-d649701a3f90 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-2c7a1254-e611-4f78-99b3-e3e451824431 req-4def4326-6b50-4e4f-9bc9-783d82899c24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.037990 Nov 28 06:41:16 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 70/202] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:16 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting quotas for project a07e9312175c4e73aa29a51865d61ebd. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting quotas for user c13b793a926942e88fc3416cf3fa005e and project a07e9312175c4e73aa29a51865d61ebd. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:41:16 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:41:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-875b9330-7263-4d66-8555-47064516de7a tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.485850 Nov 28 06:41:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 67/203] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 06:41:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 06:41:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-a379b5c5-a797-4e95-8eb2-47a7f96bfbe3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:17 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-a379b5c5-a797-4e95-8eb2-47a7f96bfbe3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "97c7e28d-01ae-4b01-8594-2e507f37eeb7"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-unplugged", "status": "completed", "tag": "6192ac90-a8ff-46d9-914f-ab6894136423"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-plugged", "status": "completed", "tag": "6192ac90-a8ff-46d9-914f-ab6894136423"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:17 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Creating event network-vif-plugged:97c7e28d-01ae-4b01-8594-2e507f37eeb7 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:17 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Creating event network-vif-unplugged:6192ac90-a8ff-46d9-914f-ab6894136423 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:17 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] Creating event network-vif-plugged:6192ac90-a8ff-46d9-914f-ab6894136423 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:17 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-1b4e8b94-ca5f-4752-a38d-213638490e09 req-61596a6f-aaf1-49c7-a683-ba215df2791d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033259 Nov 28 06:41:17 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 71/204] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:17 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:17 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-a379b5c5-a797-4e95-8eb2-47a7f96bfbe3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:17 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-a379b5c5-a797-4e95-8eb2-47a7f96bfbe3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:17 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-a379b5c5-a797-4e95-8eb2-47a7f96bfbe3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-a379b5c5-a797-4e95-8eb2-47a7f96bfbe3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5" status: 200 len: 1395 microversion: 2.87 time: 0.080678 Nov 28 06:41:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 67/205] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:41:16 2023] GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5 => generated 1395 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:41:18 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "volume-reimaged", "server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "tag": "1d9c5b72-fcf3-422e-bee9-f2fffafb9d92"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] Creating event volume-reimaged:1d9c5b72-fcf3-422e-bee9-f2fffafb9d92 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:41:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-149d8d0c-a28a-4855-84aa-9e974c6b8ffb req-1cd7b719-6174-4475-af03-7b3838fbfd69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.93 time: 0.089527 Nov 28 06:41:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 68/206] 10.0.0.210 () {70 vars in 1437 bytes} [Tue Nov 28 06:41:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:41:19 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-31b23c4d-2aef-4f75-8a48-943af1f6c411 req-33de98ed-54d4-4f5b-bd92-dde3441bffca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-deleted", "tag": "97c7e28d-01ae-4b01-8594-2e507f37eeb7"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:19 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-31b23c4d-2aef-4f75-8a48-943af1f6c411 req-33de98ed-54d4-4f5b-bd92-dde3441bffca service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:19 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-31b23c4d-2aef-4f75-8a48-943af1f6c411 req-33de98ed-54d4-4f5b-bd92-dde3441bffca service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:19 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-31b23c4d-2aef-4f75-8a48-943af1f6c411 req-33de98ed-54d4-4f5b-bd92-dde3441bffca service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:19 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-31b23c4d-2aef-4f75-8a48-943af1f6c411 req-33de98ed-54d4-4f5b-bd92-dde3441bffca service nova] Creating event network-vif-deleted:97c7e28d-01ae-4b01-8594-2e507f37eeb7 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:19 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-31b23c4d-2aef-4f75-8a48-943af1f6c411 req-33de98ed-54d4-4f5b-bd92-dde3441bffca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039740 Nov 28 06:41:19 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 72/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:19 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:19 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] Creating event network-changed:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:41:19 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-44c7c981-360e-4d03-a527-32b583567390 req-b5f5ffe1-df94-4fb0-a276-f9a6f96a84c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031570 Nov 28 06:41:19 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 68/208] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:19 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-3eb591a4-717c-4ff1-a08e-97e4c91f6cbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:19 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-3eb591a4-717c-4ff1-a08e-97e4c91f6cbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3eb591a4-717c-4ff1-a08e-97e4c91f6cbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3eb591a4-717c-4ff1-a08e-97e4c91f6cbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3eb591a4-717c-4ff1-a08e-97e4c91f6cbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3eb591a4-717c-4ff1-a08e-97e4c91f6cbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3eb591a4-717c-4ff1-a08e-97e4c91f6cbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3eb591a4-717c-4ff1-a08e-97e4c91f6cbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:20 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-3eb591a4-717c-4ff1-a08e-97e4c91f6cbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-3eb591a4-717c-4ff1-a08e-97e4c91f6cbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386" status: 200 len: 1544 microversion: 2.1 time: 0.439467 Nov 28 06:41:20 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 69/209] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:41:19 2023] GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386 => generated 1544 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:41:21 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-deleted", "tag": "6192ac90-a8ff-46d9-914f-ab6894136423"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-deleted", "tag": "a7a63db6-53d0-4e2f-acad-d649701a3f90"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] Creating event network-vif-deleted:6192ac90-a8ff-46d9-914f-ab6894136423 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] Creating event network-vif-deleted:a7a63db6-53d0-4e2f-acad-d649701a3f90 for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-354ad144-576c-4233-9b0c-2f6e76d662b7 req-a6bb1632-97b5-4602-9fd5-c7a9cc673398 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046741 Nov 28 06:41:21 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 73/210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:23 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-9a720b28-8cf7-4df7-ac6d-68ee2f06b2cb req-9cf31260-60b7-4919-a390-3bce88c67a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-deleted", "tag": "1c17febf-a6ee-4954-9d0c-f6282ae774ea"}, {"server_uuid": "04d6da52-74d4-4a87-b8b8-f5349354d8ee", "name": "network-vif-deleted", "tag": "7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9a720b28-8cf7-4df7-ac6d-68ee2f06b2cb req-9cf31260-60b7-4919-a390-3bce88c67a8c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9a720b28-8cf7-4df7-ac6d-68ee2f06b2cb req-9cf31260-60b7-4919-a390-3bce88c67a8c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9a720b28-8cf7-4df7-ac6d-68ee2f06b2cb req-9cf31260-60b7-4919-a390-3bce88c67a8c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-9a720b28-8cf7-4df7-ac6d-68ee2f06b2cb req-9cf31260-60b7-4919-a390-3bce88c67a8c service nova] Creating event network-vif-deleted:1c17febf-a6ee-4954-9d0c-f6282ae774ea for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-9a720b28-8cf7-4df7-ac6d-68ee2f06b2cb req-9cf31260-60b7-4919-a390-3bce88c67a8c service nova] Creating event network-vif-deleted:7e4ed8f6-1a6a-42cb-ac7b-dbd5a2858bdf for instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee on user Nov 28 06:41:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-9a720b28-8cf7-4df7-ac6d-68ee2f06b2cb req-9cf31260-60b7-4919-a390-3bce88c67a8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063291 Nov 28 06:41:23 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 69/211] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-55085195-d749-42f7-9ba9-28339c4408af tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-55085195-d749-42f7-9ba9-28339c4408af tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55085195-d749-42f7-9ba9-28339c4408af tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55085195-d749-42f7-9ba9-28339c4408af tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55085195-d749-42f7-9ba9-28339c4408af tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55085195-d749-42f7-9ba9-28339c4408af tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55085195-d749-42f7-9ba9-28339c4408af tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55085195-d749-42f7-9ba9-28339c4408af tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-55085195-d749-42f7-9ba9-28339c4408af tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047739 Nov 28 06:41:27 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 70/212] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:41:27 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4d6bbcaf-5d45-4304-9e1f-40720cb2548c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:27 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4d6bbcaf-5d45-4304-9e1f-40720cb2548c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d6bbcaf-5d45-4304-9e1f-40720cb2548c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d6bbcaf-5d45-4304-9e1f-40720cb2548c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d6bbcaf-5d45-4304-9e1f-40720cb2548c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d6bbcaf-5d45-4304-9e1f-40720cb2548c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d6bbcaf-5d45-4304-9e1f-40720cb2548c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d6bbcaf-5d45-4304-9e1f-40720cb2548c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4d6bbcaf-5d45-4304-9e1f-40720cb2548c tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Nov 28 06:41:27 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 74/213] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:41:27 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:27 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:27 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:27 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:27 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lazy-loading 'services' on Instance uuid 66c94c69-4907-404d-ad02-d8ba2716a4e7 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:41:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-3cc4ddae-275b-469c-9856-366469e4e1a9 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments/d6b27c97-e46a-41e7-8096-86cbe43a8b11" status: 202 len: 0 microversion: 2.1 time: 0.224880 Nov 28 06:41:27 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 70/214] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:41:27 2023] DELETE /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments/d6b27c97-e46a-41e7-8096-86cbe43a8b11 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8a9c4bad-39b2-45fd-a1a9-40270f8f9428 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8a9c4bad-39b2-45fd-a1a9-40270f8f9428 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a9c4bad-39b2-45fd-a1a9-40270f8f9428 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a9c4bad-39b2-45fd-a1a9-40270f8f9428 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a9c4bad-39b2-45fd-a1a9-40270f8f9428 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a9c4bad-39b2-45fd-a1a9-40270f8f9428 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a9c4bad-39b2-45fd-a1a9-40270f8f9428 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a9c4bad-39b2-45fd-a1a9-40270f8f9428 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8a9c4bad-39b2-45fd-a1a9-40270f8f9428 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 Nov 28 06:41:27 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 71/215] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:41:27 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:31 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "name": "network-vif-plugged", "status": "completed", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:31 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=118,nova_cell1:UPDATE=7,nova_cell1:INSERT=7,nova_cell1:DELETE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] Creating event network-vif-plugged:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:41:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-4d4fc991-473c-4a17-a12b-c5caf23d7bb1 req-c354060c-0414-4aa6-9965-f519aa480253 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041977 Nov 28 06:41:31 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 75/216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:33 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "name": "network-vif-plugged", "status": "completed", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:33 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:33 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=109,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:33 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] Creating event network-vif-plugged:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:41:33 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-676e4f30-fae2-410e-8049-7d25c1e2d033 req-cb3f1428-1e41-47cc-8606-4c0c1e71e750 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056357 Nov 28 06:41:33 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 71/217] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:36 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-856f860e-df19-4e23-ac4c-ad0d74e8a810 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:36 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-856f860e-df19-4e23-ac4c-ad0d74e8a810 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-856f860e-df19-4e23-ac4c-ad0d74e8a810 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-856f860e-df19-4e23-ac4c-ad0d74e8a810 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-856f860e-df19-4e23-ac4c-ad0d74e8a810 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-856f860e-df19-4e23-ac4c-ad0d74e8a810 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-856f860e-df19-4e23-ac4c-ad0d74e8a810 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-856f860e-df19-4e23-ac4c-ad0d74e8a810 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:37 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-856f860e-df19-4e23-ac4c-ad0d74e8a810 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043848 Nov 28 06:41:37 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 72/218] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:41:36 2023] GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-759299404", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "01113f65-069a-4a01-937f-ff095f88202b"}]}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] validate_networks() for [('01113f65-069a-4a01-937f-ff095f88202b', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Getting quotas for project c265a98d205f4b679d3a810b4745691a. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Getting quotas for user 3e8b23eae758490a8a2476797479f208 and project c265a98d205f4b679d3a810b4745691a. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:41:37 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:41:37 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4e5772bd-8c02-4416-916e-ae8724976587 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.548463 Nov 28 06:41:37 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 76/219] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:41:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:41:37 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-cc9ebd63-8fca-4710-84b6-ad75edbf3852 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:37 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cc9ebd63-8fca-4710-84b6-ad75edbf3852 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:37 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-cc9ebd63-8fca-4710-84b6-ad75edbf3852 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8b23eae758490a8a2476797479f208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c265a98d205f4b679d3a810b4745691a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:37 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-cc9ebd63-8fca-4710-84b6-ad75edbf3852 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580" status: 200 len: 1209 microversion: 2.1 time: 0.066722 Nov 28 06:41:37 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 72/220] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:41:37 2023] GET /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580 => generated 1209 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:41:39 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:39 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] Creating event network-vif-plugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:41:39 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-48b04c40-ddb6-46cd-a182-e4d76b34301d req-6fc5051b-5c37-42c6-b90c-9b03e6f1bdc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058205 Nov 28 06:41:39 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 73/221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:41 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}, {"name": "network-changed", "server_uuid": "93f30c00-ea3c-445c-b0c9-5ef899412580", "tag": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:41 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Creating event network-vif-plugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:41:41 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] Creating event network-changed:1cc3fcfe-307b-49f6-bb59-b8b33aa7764a for instance 93f30c00-ea3c-445c-b0c9-5ef899412580 on user Nov 28 06:41:41 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-00917b6a-3142-43c0-94ac-e9297d6620fc req-5ff2e4fc-a7bb-4f13-ad07-a1fb5d947338 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039266 Nov 28 06:41:41 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 77/222] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:41 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:43 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f30c00-ea3c-445c-b0c9-5ef899412580", "name": "network-vif-plugged", "status": "completed", "tag": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a"}, {"server_uuid": "93f30c00-ea3c-445c-b0c9-5ef899412580", "name": "network-vif-plugged", "status": "completed", "tag": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Creating event network-vif-plugged:1cc3fcfe-307b-49f6-bb59-b8b33aa7764a for instance 93f30c00-ea3c-445c-b0c9-5ef899412580 on user Nov 28 06:41:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] Creating event network-vif-plugged:1cc3fcfe-307b-49f6-bb59-b8b33aa7764a for instance 93f30c00-ea3c-445c-b0c9-5ef899412580 on user Nov 28 06:41:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-29c2effa-9a84-41c0-af35-2c9b8a078537 req-0be142ce-d1bd-4c0e-a44e-33d9c7a6ab14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033258 Nov 28 06:41:43 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 73/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:44 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:44 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-97975524-0d59-40e7-a686-ef9c7221c545 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079" status: 200 len: 1858 microversion: 2.93 time: 0.225368 Nov 28 06:41:44 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 74/224] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:41:44 2023] GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079 => generated 1858 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:41:47 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-16e6f4f8-5f78-4271-b8f4-a4ba974b273b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:47 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-16e6f4f8-5f78-4271-b8f4-a4ba974b273b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-16e6f4f8-5f78-4271-b8f4-a4ba974b273b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-16e6f4f8-5f78-4271-b8f4-a4ba974b273b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-16e6f4f8-5f78-4271-b8f4-a4ba974b273b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-16e6f4f8-5f78-4271-b8f4-a4ba974b273b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-16e6f4f8-5f78-4271-b8f4-a4ba974b273b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-16e6f4f8-5f78-4271-b8f4-a4ba974b273b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-16e6f4f8-5f78-4271-b8f4-a4ba974b273b tempest-VolumesAssistedSnapshotsTest-1256151670 tempest-VolumesAssistedSnapshotsTest-1256151670-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087399 Nov 28 06:41:47 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 78/225] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:41:47 2023] GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:41:52 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:41:52 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:52 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:52 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:41:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-cd63aa11-bdc5-492b-a3c2-ac11dadb6f61 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00" status: 204 len: 0 microversion: 2.1 time: 0.118607 Nov 28 06:41:52 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 74/226] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:41:52 2023] DELETE /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:41:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-547aa08f-8c19-4b7d-830a-4ae8d697de6c tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:52 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-547aa08f-8c19-4b7d-830a-4ae8d697de6c tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-547aa08f-8c19-4b7d-830a-4ae8d697de6c tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-547aa08f-8c19-4b7d-830a-4ae8d697de6c tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-547aa08f-8c19-4b7d-830a-4ae8d697de6c tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-547aa08f-8c19-4b7d-830a-4ae8d697de6c tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-547aa08f-8c19-4b7d-830a-4ae8d697de6c tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-547aa08f-8c19-4b7d-830a-4ae8d697de6c tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:53 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-547aa08f-8c19-4b7d-830a-4ae8d697de6c tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f854afd1c504c7ba7eea6643d7bc7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8c916eb72b4f5cb1b3fa97845e2072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-547aa08f-8c19-4b7d-830a-4ae8d697de6c tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00" status: 200 len: 1673 microversion: 2.1 time: 0.618718 Nov 28 06:41:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 75/227] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:41:52 2023] GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00 => generated 1673 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:41:53 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3406c2b-4e6e-4be0-b84a-168c59322f00", "name": "network-vif-unplugged", "status": "completed", "tag": "44cb2e46-5eae-4728-ac61-29177ecb06f6"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] Creating event network-vif-unplugged:44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance e3406c2b-4e6e-4be0-b84a-168c59322f00 on user Nov 28 06:41:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-dabc2895-57c9-49fd-b8dc-216cd0f60d51 req-c34a71d8-572f-43e1-bacc-81237c4b2b95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051449 Nov 28 06:41:53 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 79/228] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0597711f-82c8-4c14-a7b2-44afd5fa7584 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:54 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-0597711f-82c8-4c14-a7b2-44afd5fa7584 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0597711f-82c8-4c14-a7b2-44afd5fa7584 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0597711f-82c8-4c14-a7b2-44afd5fa7584 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0597711f-82c8-4c14-a7b2-44afd5fa7584 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0597711f-82c8-4c14-a7b2-44afd5fa7584 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0597711f-82c8-4c14-a7b2-44afd5fa7584 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0597711f-82c8-4c14-a7b2-44afd5fa7584 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:55 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0597711f-82c8-4c14-a7b2-44afd5fa7584 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0597711f-82c8-4c14-a7b2-44afd5fa7584 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1" status: 200 len: 1502 microversion: 2.1 time: 0.200068 Nov 28 06:41:55 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 75/229] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:41:54 2023] GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1 => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:41:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3406c2b-4e6e-4be0-b84a-168c59322f00", "name": "network-vif-plugged", "status": "completed", "tag": "44cb2e46-5eae-4728-ac61-29177ecb06f6"}, {"server_uuid": "e3406c2b-4e6e-4be0-b84a-168c59322f00", "name": "network-vif-deleted", "tag": "44cb2e46-5eae-4728-ac61-29177ecb06f6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] Creating event network-vif-plugged:44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance e3406c2b-4e6e-4be0-b84a-168c59322f00 on user Nov 28 06:41:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] Creating event network-vif-deleted:44cb2e46-5eae-4728-ac61-29177ecb06f6 for instance e3406c2b-4e6e-4be0-b84a-168c59322f00 on user Nov 28 06:41:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-b7cee3c1-7a9c-4e2b-a5f1-fba0dd68bc76 req-e1dc9c86-4d4e-4186-8b58-d0189244cffb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029400 Nov 28 06:41:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 76/230] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:41:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:55 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:55 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:41:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-594ff519-3d0d-4e68-acdf-ece8b8015819 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025" status: 204 len: 0 microversion: 2.1 time: 0.623495 Nov 28 06:41:56 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 80/231] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:41:55 2023] DELETE /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 28 06:41:56 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c1747b2b-35cf-4ec0-acdc-33381e3d724e tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:41:56 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-c1747b2b-35cf-4ec0-acdc-33381e3d724e tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:41:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c1747b2b-35cf-4ec0-acdc-33381e3d724e tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c1747b2b-35cf-4ec0-acdc-33381e3d724e tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c1747b2b-35cf-4ec0-acdc-33381e3d724e tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c1747b2b-35cf-4ec0-acdc-33381e3d724e tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c1747b2b-35cf-4ec0-acdc-33381e3d724e tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c1747b2b-35cf-4ec0-acdc-33381e3d724e tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:56 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-c1747b2b-35cf-4ec0-acdc-33381e3d724e tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:41:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c1747b2b-35cf-4ec0-acdc-33381e3d724e tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025" status: 200 len: 1497 microversion: 2.1 time: 0.248676 Nov 28 06:41:56 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 76/232] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:41:56 2023] GET /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025 => generated 1497 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:41:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317be079-9b77-4139-88a4-36efb848c025", "name": "network-vif-unplugged", "status": "completed", "tag": "61814597-e5ae-41b8-9cfb-2de8d8f596ef"}, {"server_uuid": "317be079-9b77-4139-88a4-36efb848c025", "name": "network-vif-plugged", "status": "completed", "tag": "61814597-e5ae-41b8-9cfb-2de8d8f596ef"}, {"server_uuid": "317be079-9b77-4139-88a4-36efb848c025", "name": "network-vif-deleted", "tag": "61814597-e5ae-41b8-9cfb-2de8d8f596ef"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:41:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:41:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:41:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:41:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Creating event network-vif-unplugged:61814597-e5ae-41b8-9cfb-2de8d8f596ef for instance 317be079-9b77-4139-88a4-36efb848c025 on user Nov 28 06:41:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Creating event network-vif-plugged:61814597-e5ae-41b8-9cfb-2de8d8f596ef for instance 317be079-9b77-4139-88a4-36efb848c025 on user Nov 28 06:41:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] Creating event network-vif-deleted:61814597-e5ae-41b8-9cfb-2de8d8f596ef for instance 317be079-9b77-4139-88a4-36efb848c025 on user Nov 28 06:41:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-84e56310-9666-499c-a140-069a27249e75 req-68a493cf-d51f-4176-a8ba-859de8bfe3e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033309 Nov 28 06:41:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 77/233] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:41:57 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e33fb08e-c1fe-48b2-b7da-9d6e164cc40c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:00 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e33fb08e-c1fe-48b2-b7da-9d6e164cc40c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e33fb08e-c1fe-48b2-b7da-9d6e164cc40c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e33fb08e-c1fe-48b2-b7da-9d6e164cc40c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e33fb08e-c1fe-48b2-b7da-9d6e164cc40c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e33fb08e-c1fe-48b2-b7da-9d6e164cc40c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e33fb08e-c1fe-48b2-b7da-9d6e164cc40c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e33fb08e-c1fe-48b2-b7da-9d6e164cc40c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:00 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-e33fb08e-c1fe-48b2-b7da-9d6e164cc40c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73373ee05e1b4e09b5c0870750a77262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cff8da56da484d9dfee1b8118474b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e33fb08e-c1fe-48b2-b7da-9d6e164cc40c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" status: 200 len: 1535 microversion: 2.1 time: 0.223265 Nov 28 06:42:00 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 81/234] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:00 2023] GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 => generated 1535 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:02 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5", "tag": "3910f97d-105a-4142-a3ab-effc57185190"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:02 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] Creating event network-changed:3910f97d-105a-4142-a3ab-effc57185190 for instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 on user Nov 28 06:42:02 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e9db294b-ca45-4df2-99ac-5e98a140b0fe req-fd6ad028-db95-4d99-9990-68050f9077b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035281 Nov 28 06:42:02 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 77/235] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:03 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "981eddb7-039a-4cfc-9b60-ecdebff98251"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:03 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:03 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:03 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:03 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ae0c683b-67b3-430e-b7f7-31d885622a85 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294255 Nov 28 06:42:03 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 78/236] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:42:03 2023] POST /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:04 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] HTTP exception thrown: Instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee could not be found. Nov 28 06:42:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Returning 404 to user: Instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:42:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-89bb6848-cdee-4c66-b97f-69c7c3155dc2 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee" status: 404 len: 111 microversion: 2.32 time: 0.031244 Nov 28 06:42:04 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 82/237] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:42:04 2023] GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:42:04 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-7f9773db-b239-4e79-9a43-f1a1c9d6583d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '.version_select at 0x7f0b03cae4d0>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-7f9773db-b239-4e79-9a43-f1a1c9d6583d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304188480" status: 204 len: 0 microversion: 2.32 time: 0.026249 Nov 28 06:42:04 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 78/238] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 06:42:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304188480 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:42:06 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6699ac4b-68ce-4435-abb9-986a8dd347bb tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:06 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6699ac4b-68ce-4435-abb9-986a8dd347bb tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6699ac4b-68ce-4435-abb9-986a8dd347bb tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6699ac4b-68ce-4435-abb9-986a8dd347bb tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6699ac4b-68ce-4435-abb9-986a8dd347bb tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6699ac4b-68ce-4435-abb9-986a8dd347bb tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6699ac4b-68ce-4435-abb9-986a8dd347bb tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6699ac4b-68ce-4435-abb9-986a8dd347bb tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:06 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-6699ac4b-68ce-4435-abb9-986a8dd347bb tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6699ac4b-68ce-4435-abb9-986a8dd347bb tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1658 microversion: 2.1 time: 0.220423 Nov 28 06:42:06 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 79/239] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:06 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1658 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8b4ea4e-a453-4e9f-b0cf-79f87998b488"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:06 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:07 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f0f868cf-7ed6-4cc2-9b27-e0ad2eddc4a2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "POST /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277410 Nov 28 06:42:07 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 83/240] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:42:06 2023] POST /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:07 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:07 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-311069a5-286a-445f-b185-564b4f40a307 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5" status: 200 len: 1770 microversion: 2.87 time: 0.262874 Nov 28 06:42:07 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 79/241] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:42:07 2023] GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5 => generated 1770 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:42:08 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:08 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:08 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] HTTP exception thrown: Instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee could not be found. Nov 28 06:42:08 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Returning 404 to user: Instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:42:08 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a52dde42-5bd5-439d-a393-ff7b0484377d tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee" status: 404 len: 111 microversion: 2.32 time: 0.038382 Nov 28 06:42:08 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 80/242] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:42:08 2023] DELETE /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:42:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:08 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] [instance: 04d6da52-74d4-4a87-b8b8-f5349354d8ee] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] HTTP exception thrown: Instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee could not be found. Nov 28 06:42:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] Returning 404 to user: Instance 04d6da52-74d4-4a87-b8b8-f5349354d8ee could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:42:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d8708058-f52a-4417-bfc2-470e63d4cef9 tempest-TaggedBootDevicesTest-809434738 tempest-TaggedBootDevicesTest-809434738-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee" status: 404 len: 111 microversion: 2.32 time: 0.027504 Nov 28 06:42:08 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 84/243] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:42:08 2023] GET /compute/v2.1/servers/04d6da52-74d4-4a87-b8b8-f5349354d8ee => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 28 06:42:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-175f5049-1ec8-4ea4-8029-aed3aab6ccfe tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:12 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-175f5049-1ec8-4ea4-8029-aed3aab6ccfe tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-175f5049-1ec8-4ea4-8029-aed3aab6ccfe tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-175f5049-1ec8-4ea4-8029-aed3aab6ccfe tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-175f5049-1ec8-4ea4-8029-aed3aab6ccfe tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-175f5049-1ec8-4ea4-8029-aed3aab6ccfe tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-175f5049-1ec8-4ea4-8029-aed3aab6ccfe tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-175f5049-1ec8-4ea4-8029-aed3aab6ccfe tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:12 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-175f5049-1ec8-4ea4-8029-aed3aab6ccfe tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f53e7a2f95545d196a5b2d36ef6d692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30dc21619f949b18be9362b217e7c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-175f5049-1ec8-4ea4-8029-aed3aab6ccfe tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620" status: 200 len: 1667 microversion: 2.1 time: 0.213191 Nov 28 06:42:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 80/244] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:12 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620 => generated 1667 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:12 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a1e0169-c086-4acb-a496-a8a00aaeca65"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:12 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:12 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-2df0e55b-be66-4058-82e6-fa9ea2ec4fa0 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315233 Nov 28 06:42:12 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 81/245] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:42:12 2023] POST /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:14 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:15 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'services' on Instance uuid 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:42:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-8b35410e-814b-48c7-a80f-27265dcfeda0 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/os-volume_attachments/981eddb7-039a-4cfc-9b60-ecdebff98251" status: 202 len: 0 microversion: 2.1 time: 0.186991 Nov 28 06:42:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 85/246] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:42:14 2023] DELETE /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/os-volume_attachments/981eddb7-039a-4cfc-9b60-ecdebff98251 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:42:15 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8678ce0f-5640-4607-9730-2d8a2db69052 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:15 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8678ce0f-5640-4607-9730-2d8a2db69052 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8678ce0f-5640-4607-9730-2d8a2db69052 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8678ce0f-5640-4607-9730-2d8a2db69052 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8678ce0f-5640-4607-9730-2d8a2db69052 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8678ce0f-5640-4607-9730-2d8a2db69052 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8678ce0f-5640-4607-9730-2d8a2db69052 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8678ce0f-5640-4607-9730-2d8a2db69052 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:15 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-8678ce0f-5640-4607-9730-2d8a2db69052 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092711 Nov 28 06:42:15 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 81/247] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:42:15 2023] GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e703288c-d646-4e09-ada9-e533ea2007cd tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:17 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e703288c-d646-4e09-ada9-e533ea2007cd tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e703288c-d646-4e09-ada9-e533ea2007cd tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e703288c-d646-4e09-ada9-e533ea2007cd tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e703288c-d646-4e09-ada9-e533ea2007cd tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e703288c-d646-4e09-ada9-e533ea2007cd tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e703288c-d646-4e09-ada9-e533ea2007cd tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e703288c-d646-4e09-ada9-e533ea2007cd tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:17 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e703288c-d646-4e09-ada9-e533ea2007cd tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053606 Nov 28 06:42:17 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 86/248] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:42:17 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Old instance type m1.tiny, new instance type m1.small {{(pid=64871) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting quotas for project 739e836995bb4af6a877468ec43d0cf3. Resources: {'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:42:17 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Getting quotas for user 18ee95f099b64968984fd3b9e418b048 and project 739e836995bb4af6a877468ec43d0cf3. Resources: {'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:42:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-96540b82-d64a-49aa-a461-fc150e195702 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "POST /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7/action" status: 202 len: 0 microversion: 2.1 time: 0.326264 Nov 28 06:42:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 82/249] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:42:17 2023] POST /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:42:18 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4fe7ddb7-03c3-47ca-b000-337d55d05ed9 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-ec6ca131-6715-419a-a550-baa998d9df4f tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7" status: 204 len: 0 microversion: 2.1 time: 0.138456 Nov 28 06:42:18 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4fe7ddb7-03c3-47ca-b000-337d55d05ed9 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:18 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 82/250] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:42:18 2023] DELETE /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5d294a3d-b061-4195-998d-ba07923be278 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-5d294a3d-b061-4195-998d-ba07923be278 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe7ddb7-03c3-47ca-b000-337d55d05ed9 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe7ddb7-03c3-47ca-b000-337d55d05ed9 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe7ddb7-03c3-47ca-b000-337d55d05ed9 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe7ddb7-03c3-47ca-b000-337d55d05ed9 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe7ddb7-03c3-47ca-b000-337d55d05ed9 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4fe7ddb7-03c3-47ca-b000-337d55d05ed9 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d294a3d-b061-4195-998d-ba07923be278 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d294a3d-b061-4195-998d-ba07923be278 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d294a3d-b061-4195-998d-ba07923be278 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d294a3d-b061-4195-998d-ba07923be278 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d294a3d-b061-4195-998d-ba07923be278 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d294a3d-b061-4195-998d-ba07923be278 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:18 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-4fe7ddb7-03c3-47ca-b000-337d55d05ed9 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:18 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-5d294a3d-b061-4195-998d-ba07923be278 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7f2a6787cd478ca419181fdb7ab317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0402c76fe47cd8cd65d2ef23c46f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5d294a3d-b061-4195-998d-ba07923be278 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7" status: 200 len: 1645 microversion: 2.1 time: 0.330501 Nov 28 06:42:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 83/251] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:18 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7 => generated 1645 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4fe7ddb7-03c3-47ca-b000-337d55d05ed9 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1713 microversion: 2.1 time: 0.341443 Nov 28 06:42:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 87/252] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:18 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1713 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c94c69-4907-404d-ad02-d8ba2716a4e7", "name": "network-vif-unplugged", "status": "completed", "tag": "affac6e2-50a7-44d2-b7ba-ec18341bb71f"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] Creating event network-vif-unplugged:affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 on user Nov 28 06:42:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-d8427232-0a53-4b92-8794-b94b4fcbe002 req-d94556e5-c57a-4a8d-b825-95e1bd864ef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053893 Nov 28 06:42:18 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 83/253] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:20 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-6d55f14a-6e5f-4db9-b730-a0ccc0f07f41 req-4438db60-6b29-44ae-8935-9c4c97840f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c94c69-4907-404d-ad02-d8ba2716a4e7", "name": "network-vif-deleted", "tag": "affac6e2-50a7-44d2-b7ba-ec18341bb71f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6d55f14a-6e5f-4db9-b730-a0ccc0f07f41 req-4438db60-6b29-44ae-8935-9c4c97840f91 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6d55f14a-6e5f-4db9-b730-a0ccc0f07f41 req-4438db60-6b29-44ae-8935-9c4c97840f91 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6d55f14a-6e5f-4db9-b730-a0ccc0f07f41 req-4438db60-6b29-44ae-8935-9c4c97840f91 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-6d55f14a-6e5f-4db9-b730-a0ccc0f07f41 req-4438db60-6b29-44ae-8935-9c4c97840f91 service nova] Creating event network-vif-deleted:affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 on user Nov 28 06:42:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-6d55f14a-6e5f-4db9-b730-a0ccc0f07f41 req-4438db60-6b29-44ae-8935-9c4c97840f91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042183 Nov 28 06:42:20 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 84/254] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:20 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-776c7fbf-c319-454e-b1a0-10cf68dae3f9 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:20 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-776c7fbf-c319-454e-b1a0-10cf68dae3f9 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-776c7fbf-c319-454e-b1a0-10cf68dae3f9 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-776c7fbf-c319-454e-b1a0-10cf68dae3f9 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-776c7fbf-c319-454e-b1a0-10cf68dae3f9 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-776c7fbf-c319-454e-b1a0-10cf68dae3f9 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-776c7fbf-c319-454e-b1a0-10cf68dae3f9 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-776c7fbf-c319-454e-b1a0-10cf68dae3f9 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-776c7fbf-c319-454e-b1a0-10cf68dae3f9 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.159739 Nov 28 06:42:20 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 88/255] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:42:20 2023] GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386/os-interface => generated 283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:20 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c94c69-4907-404d-ad02-d8ba2716a4e7", "name": "network-vif-plugged", "status": "completed", "tag": "affac6e2-50a7-44d2-b7ba-ec18341bb71f"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] Creating event network-vif-plugged:affac6e2-50a7-44d2-b7ba-ec18341bb71f for instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 on user Nov 28 06:42:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-4fbeb650-9f00-4ccb-8118-2584cacbdf46 req-90248ce1-746c-4b21-96e6-7376b3f9d368 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044984 Nov 28 06:42:20 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 84/256] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:42:21 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-unplugged", "status": "completed", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] Creating event network-vif-unplugged:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:42:21 user devstack@n-api.service[64871]: DEBUG nova.compute.api [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:42:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-b463beb5-b4fb-46e7-b93a-976b52fb72b7 req-29c49a65-cec9-4db3-81dc-9e6470a34ca2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082253 Nov 28 06:42:21 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 85/257] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:21 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-fc878879-efec-45b4-a0d9-9af622f76f99 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:21 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-fc878879-efec-45b4-a0d9-9af622f76f99 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc878879-efec-45b4-a0d9-9af622f76f99 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc878879-efec-45b4-a0d9-9af622f76f99 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc878879-efec-45b4-a0d9-9af622f76f99 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc878879-efec-45b4-a0d9-9af622f76f99 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc878879-efec-45b4-a0d9-9af622f76f99 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc878879-efec-45b4-a0d9-9af622f76f99 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-fc878879-efec-45b4-a0d9-9af622f76f99 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386/ips" status: 200 len: 109 microversion: 2.1 time: 0.036353 Nov 28 06:42:21 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 89/258] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:42:21 2023] GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386/ips => generated 109 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:21 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:21 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Invalid volume: volume 53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 is already attached to instances: b4802806-6422-46da-8d0f-5674af0a8433 Nov 28 06:42:22 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 400 to user: Invalid volume: volume 53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 is already attached to instances: b4802806-6422-46da-8d0f-5674af0a8433 {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:42:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-78d79707-b8b6-4bc3-9479-dd35be351c21 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.161770 Nov 28 06:42:22 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 85/259] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:42:21 2023] POST /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:42:22 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:22 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:22 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:42:22 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-75534a77-a434-4835-85ea-7282a41e85f2 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386" status: 204 len: 0 microversion: 2.1 time: 0.688034 Nov 28 06:42:22 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 86/260] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:42:22 2023] DELETE /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:42:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-63d7a04d-6961-42b7-b7bf-49a270343396 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:22 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-63d7a04d-6961-42b7-b7bf-49a270343396 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-63d7a04d-6961-42b7-b7bf-49a270343396 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-63d7a04d-6961-42b7-b7bf-49a270343396 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-63d7a04d-6961-42b7-b7bf-49a270343396 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-63d7a04d-6961-42b7-b7bf-49a270343396 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-63d7a04d-6961-42b7-b7bf-49a270343396 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-63d7a04d-6961-42b7-b7bf-49a270343396 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:22 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-63d7a04d-6961-42b7-b7bf-49a270343396 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-63d7a04d-6961-42b7-b7bf-49a270343396 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386" status: 200 len: 1550 microversion: 2.1 time: 0.207796 Nov 28 06:42:22 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 90/261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:22 2023] GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386 => generated 1550 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30131e3-a805-4fbc-815c-7e379c44a386", "name": "network-vif-unplugged", "status": "completed", "tag": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] Creating event network-vif-unplugged:8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance b30131e3-a805-4fbc-815c-7e379c44a386 on user Nov 28 06:42:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e2f417ee-29cf-4873-adeb-3cc042f5f521 req-0d39ba6e-1b32-4b89-9293-de89585633d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045235 Nov 28 06:42:23 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 86/262] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:23 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "f40204eb-15d5-4f6d-a086-d9654a71267f"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:23 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:23 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30131e3-a805-4fbc-815c-7e379c44a386", "tag": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0"}, {"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-plugged", "status": "completed", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:23 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'flavor' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:42:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:23 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Creating event network-changed:8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance b30131e3-a805-4fbc-815c-7e379c44a386 on user Nov 28 06:42:23 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Creating event network-vif-plugged:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:42:23 user devstack@n-api.service[64872]: DEBUG nova.compute.api [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:42:23 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-02042a6c-6e0e-442c-8d38-0d0afbc9417b req-16f25fad-1068-428e-8aa7-64e7e165b52f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.119209 Nov 28 06:42:23 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 91/263] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:23 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6a380a0d-b48c-4c1c-a3e1-fca1b8cefe98 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/action" status: 200 len: 29 microversion: 2.1 time: 0.341669 Nov 28 06:42:23 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 87/264] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:42:23 2023] POST /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/action => generated 29 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-463fcd02-34b2-46ca-a97b-4f723e1a7e9f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-463fcd02-34b2-46ca-a97b-4f723e1a7e9f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-463fcd02-34b2-46ca-a97b-4f723e1a7e9f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-463fcd02-34b2-46ca-a97b-4f723e1a7e9f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-463fcd02-34b2-46ca-a97b-4f723e1a7e9f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-463fcd02-34b2-46ca-a97b-4f723e1a7e9f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-463fcd02-34b2-46ca-a97b-4f723e1a7e9f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-463fcd02-34b2-46ca-a97b-4f723e1a7e9f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:24 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-463fcd02-34b2-46ca-a97b-4f723e1a7e9f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f53e7a2f95545d196a5b2d36ef6d692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30dc21619f949b18be9362b217e7c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-463fcd02-34b2-46ca-a97b-4f723e1a7e9f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620" status: 200 len: 1719 microversion: 2.1 time: 0.758267 Nov 28 06:42:24 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 87/265] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:23 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620 => generated 1719 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:25 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30131e3-a805-4fbc-815c-7e379c44a386", "name": "network-vif-plugged", "status": "completed", "tag": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:25 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] Creating event network-vif-plugged:8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance b30131e3-a805-4fbc-815c-7e379c44a386 on user Nov 28 06:42:25 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-9b61d0b0-21a8-4a1e-b082-8f02b52c546e req-13679039-21a8-4fb8-aa66-326a235db564 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030451 Nov 28 06:42:25 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 92/266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:25 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-unplugged", "status": "completed", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:25 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] Creating event network-vif-unplugged:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:42:25 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-52312105-af4e-4608-b7f3-7b621fc09c30 req-fc71aaac-d8fb-4207-bfbf-896159eb7738 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063191 Nov 28 06:42:25 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 88/267] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:25 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-2855098c-8dea-47d0-a8d3-517920cd3679 req-517a2fb7-dec8-4e66-9a84-b595872656cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30131e3-a805-4fbc-815c-7e379c44a386", "name": "network-vif-deleted", "tag": "8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2855098c-8dea-47d0-a8d3-517920cd3679 req-517a2fb7-dec8-4e66-9a84-b595872656cb service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2855098c-8dea-47d0-a8d3-517920cd3679 req-517a2fb7-dec8-4e66-9a84-b595872656cb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2855098c-8dea-47d0-a8d3-517920cd3679 req-517a2fb7-dec8-4e66-9a84-b595872656cb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-2855098c-8dea-47d0-a8d3-517920cd3679 req-517a2fb7-dec8-4e66-9a84-b595872656cb service nova] Creating event network-vif-deleted:8bf5bfdf-5d58-4633-a465-67d1cdb5a7e0 for instance b30131e3-a805-4fbc-815c-7e379c44a386 on user Nov 28 06:42:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-2855098c-8dea-47d0-a8d3-517920cd3679 req-517a2fb7-dec8-4e66-9a84-b595872656cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047598 Nov 28 06:42:25 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 88/268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-plugged", "status": "completed", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] Creating event network-vif-plugged:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:42:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-3804d564-d4e0-4d8d-9793-889fa3d1fcda req-0e44a71b-9608-48aa-ab7f-a49fd5fac20a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065740 Nov 28 06:42:27 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 93/269] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:27 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-fea67c14-1212-4e52-9187-b3d147a275cb tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:27 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-fea67c14-1212-4e52-9187-b3d147a275cb tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fea67c14-1212-4e52-9187-b3d147a275cb tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fea67c14-1212-4e52-9187-b3d147a275cb tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fea67c14-1212-4e52-9187-b3d147a275cb tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fea67c14-1212-4e52-9187-b3d147a275cb tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fea67c14-1212-4e52-9187-b3d147a275cb tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fea67c14-1212-4e52-9187-b3d147a275cb tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:27 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:28 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-fea67c14-1212-4e52-9187-b3d147a275cb tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8b23eae758490a8a2476797479f208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c265a98d205f4b679d3a810b4745691a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-fea67c14-1212-4e52-9187-b3d147a275cb tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580" status: 200 len: 1494 microversion: 2.1 time: 0.264182 Nov 28 06:42:28 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 89/270] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:27 2023] GET /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580 => generated 1494 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:31 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-plugged", "status": "completed", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] Creating event network-vif-plugged:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:42:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-9ed7f98f-770b-4bd8-9598-689ca8382ebb req-940c0c4b-5e33-4dee-945b-90fb2d676be6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061043 Nov 28 06:42:31 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 89/271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:33 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-plugged", "status": "completed", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:33 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] Creating event network-vif-plugged:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:42:33 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-a4695a1c-f055-4190-9a84-d9ef2bcb30a3 req-0ce411d2-6341-4dbc-9111-b678cedc647d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029536 Nov 28 06:42:33 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 94/272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:36 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-2bb35d00-8f14-4241-aaed-140e27ea182a tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Action: 'create', calling method: .version_select at 0x7f0b03a0a9e0>, body: {"keypair": {"name": "tempest-keypair-695255668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4+HgYoCp1eR75WFFgMuoXnWAXtLuAPdCW9BvZW/1msrt3sQrEapbOpUrKflECyx9eBqd9Pltp9bL+zFk1ucJ6k+ZooTajxvSxguUVnY8YPKRUf+9VyF6RFls0xDaSbUA=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:36 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-2bb35d00-8f14-4241-aaed-140e27ea182a tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:42:36 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-2bb35d00-8f14-4241-aaed-140e27ea182a tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for user b7b9a26798e14399ac1a70568432485e and project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:42:36 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-2bb35d00-8f14-4241-aaed-140e27ea182a tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182340 Nov 28 06:42:36 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 90/273] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:42:36 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:37 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-1525899682", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "7ded7b1e-cfba-4af0-9866-0a4d18198920"}], "security_groups": [{"name": "tempest-securitygroup--664585304"}], "key_name": "tempest-keypair-695255668", "user_data": "}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:37 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] validate_networks() for [('7ded7b1e-cfba-4af0-9866-0a4d18198920', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for user b7b9a26798e14399ac1a70568432485e and project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:42:38 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:42:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-2ba0ba3e-f51e-4e7b-b230-f405b9499c43 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.983847 Nov 28 06:42:38 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 90/274] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:42:37 2023] POST /compute/v2.1/servers => generated 406 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:42:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-0842ce80-6478-46df-85a8-3b9623810e2d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:38 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-0842ce80-6478-46df-85a8-3b9623810e2d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:38 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-0842ce80-6478-46df-85a8-3b9623810e2d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-0842ce80-6478-46df-85a8-3b9623810e2d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1232 microversion: 2.1 time: 0.072852 Nov 28 06:42:38 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 95/275] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:38 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1232 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:41 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=10,nova_cell1:INSERT=5 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:41 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e69254a-5914-4e90-ae6e-bdf28ac716e7", "tag": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] Creating event network-changed:29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 on user Nov 28 06:42:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-66a3c8bc-4a3e-4b7b-8300-cb71c932ae77 req-ed98b20f-422c-4e0f-a5f7-3aa6affc4b95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039608 Nov 28 06:42:41 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 91/276] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:42 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-plugged", "status": "completed", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:42 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] Creating event network-vif-plugged:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:42:42 user devstack@n-api.service[64873]: DEBUG nova.compute.api [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64873) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:42:42 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-31ce736a-36a9-41ea-b2d2-9d5125a506ac req-9a0809c0-7a9d-4465-950f-a56be42854c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048860 Nov 28 06:42:42 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 91/277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:43 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] [instance: e3406c2b-4e6e-4be0-b84a-168c59322f00] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:43 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] HTTP exception thrown: Instance e3406c2b-4e6e-4be0-b84a-168c59322f00 could not be found. Nov 28 06:42:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Returning 404 to user: Instance e3406c2b-4e6e-4be0-b84a-168c59322f00 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:42:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7b7f6698-440d-4ffd-b0c3-1968054c5d07 tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00" status: 404 len: 111 microversion: 2.1 time: 0.046981 Nov 28 06:42:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 96/278] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:43 2023] GET /compute/v2.1/servers/e3406c2b-4e6e-4be0-b84a-168c59322f00 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:42:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a694ae0d-3ffc-4fd2-96ea-e396475954ed tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] Calling method '.version_select at 0x7f0b03a72320>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a694ae0d-3ffc-4fd2-96ea-e396475954ed tempest-VolumesAssistedSnapshotsTest-736418019 tempest-VolumesAssistedSnapshotsTest-736418019-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012101206" status: 202 len: 0 microversion: 2.1 time: 0.040725 Nov 28 06:42:43 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 92/279] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 06:42:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012101206 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:42:43 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e69254a-5914-4e90-ae6e-bdf28ac716e7", "name": "network-vif-plugged", "status": "completed", "tag": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] Creating event network-vif-plugged:29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 on user Nov 28 06:42:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-9939e5e0-4243-4538-832d-de2057c1d8f1 req-939d39fe-48ee-43dc-bafa-433db9952364 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035671 Nov 28 06:42:43 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 92/280] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:44 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-plugged", "status": "completed", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:44 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] Creating event network-vif-plugged:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:42:44 user devstack@n-api.service[64871]: DEBUG nova.compute.api [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:42:44 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-5897864a-b536-4978-9d86-75037a5fe8c9 req-c277c113-ed19-4ba7-b095-bc7fb000fb42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040653 Nov 28 06:42:44 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 93/281] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:44 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:44 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-ca024f90-7227-4a9c-b5a6-380a2661491c tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079" status: 200 len: 1858 microversion: 2.93 time: 0.354645 Nov 28 06:42:44 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 97/282] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:42:44 2023] GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079 => generated 1858 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:42:45 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:45 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:45 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:42:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6a52421b-f5d6-449d-8d06-1b90b777f276 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079" status: 204 len: 0 microversion: 2.93 time: 0.135356 Nov 28 06:42:45 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 93/283] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:42:45 2023] DELETE /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:45 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48e7c51916684bec98970a963f2c560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4ac048770a4680a35f71465d191d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-93bcbec1-acf3-417a-8e80-27c2433067ff tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079" status: 200 len: 1864 microversion: 2.93 time: 0.307531 Nov 28 06:42:45 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 94/284] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:42:45 2023] GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079 => generated 1864 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:42:45 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e69254a-5914-4e90-ae6e-bdf28ac716e7", "name": "network-vif-plugged", "status": "completed", "tag": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:45 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] Creating event network-vif-plugged:29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 on user Nov 28 06:42:45 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-9732a79c-4810-4fe0-b256-db7a8dcb8e23 req-f068a568-e873-462b-81c1-fa0576ed65bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037030 Nov 28 06:42:45 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 98/285] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:46 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:46 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] HTTP exception thrown: Instance 317be079-9b77-4139-88a4-36efb848c025 could not be found. Nov 28 06:42:46 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Returning 404 to user: Instance 317be079-9b77-4139-88a4-36efb848c025 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:42:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-41ae299d-8429-4efa-b5af-de9532ee6eaa tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025" status: 404 len: 111 microversion: 2.1 time: 0.045593 Nov 28 06:42:46 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 94/286] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:46 2023] GET /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:42:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e7ec3dfb-d09f-403e-ae25-7b61cd18138c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:46 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e7ec3dfb-d09f-403e-ae25-7b61cd18138c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e7ec3dfb-d09f-403e-ae25-7b61cd18138c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e7ec3dfb-d09f-403e-ae25-7b61cd18138c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e7ec3dfb-d09f-403e-ae25-7b61cd18138c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e7ec3dfb-d09f-403e-ae25-7b61cd18138c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e7ec3dfb-d09f-403e-ae25-7b61cd18138c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e7ec3dfb-d09f-403e-ae25-7b61cd18138c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "name": "network-vif-unplugged", "status": "completed", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}, {"server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "name": "network-vif-plugged", "status": "completed", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Creating event network-vif-unplugged:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:42:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] Creating event network-vif-plugged:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:42:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-89bb3112-8bbf-4ec2-9ae9-254ff20a44fc req-6108784e-8d68-4370-baa0-33a07bce2ba7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045472 Nov 28 06:42:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 99/287] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:46 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:46 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:46 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-e7ec3dfb-d09f-403e-ae25-7b61cd18138c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e7ec3dfb-d09f-403e-ae25-7b61cd18138c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" status: 200 len: 1491 microversion: 2.1 time: 0.382183 Nov 28 06:42:46 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 95/288] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:46 2023] GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e => generated 1491 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:47 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-373d2738-a52f-465c-a5e4-9be8638ba5f8 req-89df5b3c-2da1-47f2-99da-6e48a7a1a85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70280af1-c742-4096-9abc-7a1ca9b44079", "name": "network-vif-deleted", "tag": "e8244d47-16b3-4035-8877-b5d7b137dea6"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-373d2738-a52f-465c-a5e4-9be8638ba5f8 req-89df5b3c-2da1-47f2-99da-6e48a7a1a85b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-373d2738-a52f-465c-a5e4-9be8638ba5f8 req-89df5b3c-2da1-47f2-99da-6e48a7a1a85b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-373d2738-a52f-465c-a5e4-9be8638ba5f8 req-89df5b3c-2da1-47f2-99da-6e48a7a1a85b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:47 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-373d2738-a52f-465c-a5e4-9be8638ba5f8 req-89df5b3c-2da1-47f2-99da-6e48a7a1a85b service nova] Creating event network-vif-deleted:e8244d47-16b3-4035-8877-b5d7b137dea6 for instance 70280af1-c742-4096-9abc-7a1ca9b44079 on user Nov 28 06:42:47 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-373d2738-a52f-465c-a5e4-9be8638ba5f8 req-89df5b3c-2da1-47f2-99da-6e48a7a1a85b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058234 Nov 28 06:42:47 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 95/289] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=39 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=11 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:57 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'flavor' on Instance uuid 37549ec7-6ded-412f-8a4f-58a7469e4cd1 {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:42:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4cf0e614-d198-427d-b331-5682b021dec9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1/action" status: 200 len: 32 microversion: 2.1 time: 0.116302 Nov 28 06:42:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 100/290] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:42:57 2023] POST /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:42:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b59b161a-a0b7-4200-866b-5f108b6ab7b5 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:42:57 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-b59b161a-a0b7-4200-866b-5f108b6ab7b5 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:42:58 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:58 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=18 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b59b161a-a0b7-4200-866b-5f108b6ab7b5 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b59b161a-a0b7-4200-866b-5f108b6ab7b5 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b59b161a-a0b7-4200-866b-5f108b6ab7b5 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b59b161a-a0b7-4200-866b-5f108b6ab7b5 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b59b161a-a0b7-4200-866b-5f108b6ab7b5 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b59b161a-a0b7-4200-866b-5f108b6ab7b5 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:58 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-b59b161a-a0b7-4200-866b-5f108b6ab7b5 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:42:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b59b161a-a0b7-4200-866b-5f108b6ab7b5 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1" status: 200 len: 1508 microversion: 2.1 time: 0.364502 Nov 28 06:42:58 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 96/291] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:42:57 2023] GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1 => generated 1508 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:42:58 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:58 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:58 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:58 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:42:58 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-unplugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:42:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:42:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:42:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:42:58 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] Creating event network-vif-unplugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:42:58 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-11723599-1aba-4676-b48c-24e466056ccc req-ff0c3d20-4d1e-44f2-aa22-0e0d86b0f38e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047287 Nov 28 06:42:58 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 96/292] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:42:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-plugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] Creating event network-vif-plugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:43:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-9c6ab7a8-5a24-40b3-9d5d-b043b582dffd req-bf440229-eca0-4008-b2ef-9a46c06659e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028725 Nov 28 06:43:00 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 101/293] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:02 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-plugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}, {"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-plugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Creating event network-vif-plugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:43:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] Creating event network-vif-plugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:43:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-3f01432a-d2de-4b02-ac66-94568be547ca req-069965f0-daa7-4a88-af1f-d5372be1b6e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045424 Nov 28 06:43:02 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 97/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:05 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1323e59a-2142-44b8-8e4c-a7f7edcb7381 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:05 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-1323e59a-2142-44b8-8e4c-a7f7edcb7381 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1323e59a-2142-44b8-8e4c-a7f7edcb7381 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1323e59a-2142-44b8-8e4c-a7f7edcb7381 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1323e59a-2142-44b8-8e4c-a7f7edcb7381 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1323e59a-2142-44b8-8e4c-a7f7edcb7381 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1323e59a-2142-44b8-8e4c-a7f7edcb7381 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1323e59a-2142-44b8-8e4c-a7f7edcb7381 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1323e59a-2142-44b8-8e4c-a7f7edcb7381 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044731 Nov 28 06:43:05 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 97/295] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:43:05 2023] GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "e28daa41-f99d-45da-991c-bc57eabaaf9a"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'flavor' on Instance uuid eea1149f-7553-4beb-b8df-87822bd3abd5 {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:43:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7cb97246-4162-4895-9332-d7221d8a5cf1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5/action" status: 200 len: 29 microversion: 2.87 time: 0.522945 Nov 28 06:43:08 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 102/296] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 06:43:08 2023] POST /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5/action => generated 29 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:43:08 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:08 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] [instance: 66c94c69-4907-404d-ad02-d8ba2716a4e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d76728d1-8171-42f5-ab7a-1ac8a10e7143 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d76728d1-8171-42f5-ab7a-1ac8a10e7143 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d76728d1-8171-42f5-ab7a-1ac8a10e7143 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d76728d1-8171-42f5-ab7a-1ac8a10e7143 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d76728d1-8171-42f5-ab7a-1ac8a10e7143 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d76728d1-8171-42f5-ab7a-1ac8a10e7143 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d76728d1-8171-42f5-ab7a-1ac8a10e7143 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d76728d1-8171-42f5-ab7a-1ac8a10e7143 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] HTTP exception thrown: Instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 could not be found. Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Returning 404 to user: Instance 66c94c69-4907-404d-ad02-d8ba2716a4e7 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:43:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-208757d9-523d-45b2-a635-7fa810120652 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7" status: 404 len: 111 microversion: 2.1 time: 0.036607 Nov 28 06:43:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 98/297] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:08 2023] GET /compute/v2.1/servers/66c94c69-4907-404d-ad02-d8ba2716a4e7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-7a88d3e2-d86c-4418-b230-ddc49ed72c93 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] Calling method '.version_select at 0x7f0b03a99e10>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-7a88d3e2-d86c-4418-b230-ddc49ed72c93 tempest-TestVolumeSwap-54352515 tempest-TestVolumeSwap-54352515-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-926137104" status: 202 len: 0 microversion: 2.1 time: 0.038156 Nov 28 06:43:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 99/298] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 06:43:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-926137104 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-942014689"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:09 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-d76728d1-8171-42f5-ab7a-1ac8a10e7143 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d76728d1-8171-42f5-ab7a-1ac8a10e7143 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1712 microversion: 2.1 time: 0.514611 Nov 28 06:43:09 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 103/299] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:08 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1712 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:43:09 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:09 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:09 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d2862967-c0d4-4065-969b-c75c0615c80c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5" status: 200 len: 1776 microversion: 2.87 time: 0.848214 Nov 28 06:43:09 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 98/300] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:43:08 2023] GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5 => generated 1776 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:43:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e0b0ddb7-5c11-472c-9a6c-c86e9de5ea81 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/action" status: 202 len: 0 microversion: 2.1 time: 1.150758 Nov 28 06:43:09 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 100/301] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:43:08 2023] POST /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/action => generated 0 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 06:43:09 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-unplugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] Creating event network-vif-unplugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:43:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-c14f9da1-1390-4050-9be7-da731c8a21af req-f6f9bfcc-dc2e-4fab-b97e-32a6306d93ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033384 Nov 28 06:43:10 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 104/302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:12 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:12 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] Creating event network-vif-plugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:43:12 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-0a6ede3e-70b7-4c3f-8595-95dc8aaa3340 req-29241122-7e55-4b3d-ab94-e3666ae608c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030210 Nov 28 06:43:12 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 99/303] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:13 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:13 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:13 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance b30131e3-a805-4fbc-815c-7e379c44a386 could not be found. Nov 28 06:43:13 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance b30131e3-a805-4fbc-815c-7e379c44a386 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:43:13 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-cfcd50ae-e0f6-4f74-9b18-38b0769d4b7f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386" status: 404 len: 111 microversion: 2.1 time: 0.192977 Nov 28 06:43:13 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 101/304] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:13 2023] GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:43:13 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-dac1434b-8839-4d86-99da-b886a3d20dbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '.version_select at 0x7f0b039af6d0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:13 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-dac1434b-8839-4d86-99da-b886a3d20dbe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335441825" status: 202 len: 0 microversion: 2.1 time: 0.025373 Nov 28 06:43:13 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 105/305] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 06:43:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1335441825 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:43:13 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:13 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:14 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'services' on Instance uuid b4802806-6422-46da-8d0f-5674af0a8433 {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:43:14 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-82aee63d-db0d-4291-ae9a-ae834b1cf445 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Action: 'create', calling method: .version_select at 0x7f0b03a98d30>, body: {"keypair": {"name": "tempest-keypair-1058119261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIVLH1EMKjoa8/5idYsoqJ/Gd6qA/lgnXxioHq5yn0go7DEbTlnSQHYoZwO2InVEgB69dENX4prOHb5gFHZNz2jR3GGDYquPPt0HIfVcbrMHKnsWuf698tJWffDPd9nCg=="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:14 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8092a83a-b6cf-4a79-80ee-36544aea8d46 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/os-volume_attachments/53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2" status: 202 len: 0 microversion: 2.1 time: 0.336631 Nov 28 06:43:14 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 100/306] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:43:13 2023] DELETE /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/os-volume_attachments/53d6473d-5ca4-4bbc-8087-8a0b1e4f5db2 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:43:14 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-82aee63d-db0d-4291-ae9a-ae834b1cf445 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Getting quotas for project f11f8db963684cba9927a06dfb035bd3. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:43:14 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-82aee63d-db0d-4291-ae9a-ae834b1cf445 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Getting quotas for user 3b3ace56f1264298944b8b765f51417f and project f11f8db963684cba9927a06dfb035bd3. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:43:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9c902053-bb14-4ef4-89e6-70b1da9457cd tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:14 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-9c902053-bb14-4ef4-89e6-70b1da9457cd tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9c902053-bb14-4ef4-89e6-70b1da9457cd tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9c902053-bb14-4ef4-89e6-70b1da9457cd tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9c902053-bb14-4ef4-89e6-70b1da9457cd tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9c902053-bb14-4ef4-89e6-70b1da9457cd tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9c902053-bb14-4ef4-89e6-70b1da9457cd tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9c902053-bb14-4ef4-89e6-70b1da9457cd tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-82aee63d-db0d-4291-ae9a-ae834b1cf445 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.197409 Nov 28 06:43:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 102/307] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:43:14 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-9c902053-bb14-4ef4-89e6-70b1da9457cd tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068140 Nov 28 06:43:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 106/308] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:43:14 2023] GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:14 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e047e744-43a6-4d29-982d-56d649406bee tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:14 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e047e744-43a6-4d29-982d-56d649406bee tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e047e744-43a6-4d29-982d-56d649406bee tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e047e744-43a6-4d29-982d-56d649406bee tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e047e744-43a6-4d29-982d-56d649406bee tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e047e744-43a6-4d29-982d-56d649406bee tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e047e744-43a6-4d29-982d-56d649406bee tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e047e744-43a6-4d29-982d-56d649406bee tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:15 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-e047e744-43a6-4d29-982d-56d649406bee tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f53e7a2f95545d196a5b2d36ef6d692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30dc21619f949b18be9362b217e7c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e047e744-43a6-4d29-982d-56d649406bee tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620" status: 200 len: 1699 microversion: 2.1 time: 0.367417 Nov 28 06:43:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 101/309] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:14 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620 => generated 1699 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:43:15 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:15 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] Creating event network-vif-plugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:43:15 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-028548f9-6660-40e1-8c16-eb8b23ef66f3 req-1e5d2650-0ed8-4034-859b-2151672804c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064897 Nov 28 06:43:15 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 103/310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2105331009", "imageRef": "52b9b3f6-7ec4-4c22-9fff-9685a13fef92", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "34f8060a-c521-4e81-955b-52ed0199e018"}], "security_groups": [{"name": "tempest-securitygroup--939269813"}], "key_name": "tempest-keypair-1058119261", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] validate_networks() for [('34f8060a-c521-4e81-955b-52ed0199e018', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Getting quotas for project f11f8db963684cba9927a06dfb035bd3. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Getting quotas for user 3b3ace56f1264298944b8b765f51417f and project f11f8db963684cba9927a06dfb035bd3. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:43:16 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52b9b3f6-7ec4-4c22-9fff-9685a13fef92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:43:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-bc68e9bd-bf45-45b4-993a-8a167755e9c9 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.751605 Nov 28 06:43:16 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 107/311] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:43:15 2023] POST /compute/v2.1/servers => generated 403 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:43:16 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-746ad2f5-3560-4376-9c2a-730042a20784 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:16 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-746ad2f5-3560-4376-9c2a-730042a20784 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:16 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-746ad2f5-3560-4376-9c2a-730042a20784 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3ace56f1264298944b8b765f51417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11f8db963684cba9927a06dfb035bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-746ad2f5-3560-4376-9c2a-730042a20784 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972" status: 200 len: 1238 microversion: 2.1 time: 0.084859 Nov 28 06:43:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 102/312] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:16 2023] GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:43:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] Creating event network-vif-plugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:43:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-835941228", "imageRef": "a909e0d0-4869-4e36-a872-7b376b6589c3", "flavorRef": "1", "key_name": "tempest-TestStampPattern-1173073735", "security_groups": [{"name": "tempest-secgroup-smoke-222083240"}], "networks": [{"uuid": "a116c7b1-1d5c-4fc1-8589-714e935c8b89"}]}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-1be52a92-ff4a-460a-8351-e4a693252a30 req-54054476-410b-43a4-9a6d-58435a6f4800 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071874 Nov 28 06:43:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 104/313] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] validate_networks() for [('a116c7b1-1d5c-4fc1-8589-714e935c8b89', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Getting quotas for project 48cff8da56da484d9dfee1b8118474b9. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Getting quotas for user 73373ee05e1b4e09b5c0870750a77262 and project 48cff8da56da484d9dfee1b8118474b9. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:43:18 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a909e0d0-4869-4e36-a872-7b376b6589c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:43:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a8942657-c7c3-47dc-bb55-d82c3d8fa6a9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.844960 Nov 28 06:43:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 108/314] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:43:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:43:18 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-0227cfbf-be66-45c2-bbb7-b0360626d205 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:18 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-0227cfbf-be66-45c2-bbb7-b0360626d205 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:18 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-0227cfbf-be66-45c2-bbb7-b0360626d205 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73373ee05e1b4e09b5c0870750a77262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cff8da56da484d9dfee1b8118474b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-0227cfbf-be66-45c2-bbb7-b0360626d205 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" status: 200 len: 1234 microversion: 2.1 time: 0.106118 Nov 28 06:43:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 103/315] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:18 2023] GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c => generated 1234 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:43:21 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec477b1-ae4b-4ec0-b396-353c82f38972", "tag": "ea9497df-2959-489f-a6d7-4ce7a474741d"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:21 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] Creating event network-changed:ea9497df-2959-489f-a6d7-4ce7a474741d for instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 on user Nov 28 06:43:21 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e6cfbbb1-c11c-457a-94a6-e4bec89665b8 req-11929b6f-6861-420a-8a73-da7ec9256873 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128992 Nov 28 06:43:21 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 105/316] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c", "tag": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] Creating event network-changed:4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c on user Nov 28 06:43:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-a1fb30f6-602d-4192-a92a-1d1e502c422a req-78f0d457-a0ea-43a2-8fbc-d3c1d61b4a57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091788 Nov 28 06:43:22 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 109/317] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:26 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec477b1-ae4b-4ec0-b396-353c82f38972", "name": "network-vif-plugged", "status": "completed", "tag": "ea9497df-2959-489f-a6d7-4ce7a474741d"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:26 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:43:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:26 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] Creating event network-vif-plugged:ea9497df-2959-489f-a6d7-4ce7a474741d for instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 on user Nov 28 06:43:26 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-963dd048-0403-4074-a5b1-3dfd19531361 req-dc577dea-0efc-45d5-96d1-004e092b437d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032626 Nov 28 06:43:26 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 104/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:26 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:43:26 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c", "name": "network-vif-plugged", "status": "completed", "tag": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:26 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] Creating event network-vif-plugged:4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c on user Nov 28 06:43:26 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-bd395593-73ff-45e1-92d8-77c7e21a2ac5 req-97a152cb-4d9f-4629-b0e4-69fc6d13d872 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044702 Nov 28 06:43:26 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 106/319] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:28 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec477b1-ae4b-4ec0-b396-353c82f38972", "name": "network-vif-plugged", "status": "completed", "tag": "ea9497df-2959-489f-a6d7-4ce7a474741d"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:28 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] Creating event network-vif-plugged:ea9497df-2959-489f-a6d7-4ce7a474741d for instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 on user Nov 28 06:43:28 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-693d6857-99aa-4678-8ca0-14d9186e1481 req-5477c9e9-55e0-4ecd-809d-9f1128aed3c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048150 Nov 28 06:43:28 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 110/320] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:28 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c", "name": "network-vif-plugged", "status": "completed", "tag": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] Creating event network-vif-plugged:4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c on user Nov 28 06:43:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-d26f46dc-d13f-48eb-8db5-fd1409f323ab req-e7d7d8ce-0504-4c55-9694-8df4f670f3f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028726 Nov 28 06:43:28 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 105/321] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:29 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-57426852-98ac-45c9-85c6-2493c448dd44 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:29 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-57426852-98ac-45c9-85c6-2493c448dd44 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-57426852-98ac-45c9-85c6-2493c448dd44 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-57426852-98ac-45c9-85c6-2493c448dd44 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-57426852-98ac-45c9-85c6-2493c448dd44 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-57426852-98ac-45c9-85c6-2493c448dd44 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-57426852-98ac-45c9-85c6-2493c448dd44 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-57426852-98ac-45c9-85c6-2493c448dd44 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:29 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-57426852-98ac-45c9-85c6-2493c448dd44 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-57426852-98ac-45c9-85c6-2493c448dd44 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1540 microversion: 2.1 time: 0.652701 Nov 28 06:43:29 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 107/322] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:29 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1540 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=12 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f327631a-0fd1-4fd9-9ed2-90a37a9775e8"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] HTTP exception thrown: Volume 91aae7ac-132a-4c8d-a9ae-2550f6865ca7 could not be found. Nov 28 06:43:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] Returning 404 to user: Volume 91aae7ac-132a-4c8d-a9ae-2550f6865ca7 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:43:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-9335a26d-4556-4218-8a00-1af83d62bf99 tempest-VolumesAdminNegativeTest-749819452 tempest-VolumesAdminNegativeTest-749819452-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580/os-volume_attachments/91aae7ac-132a-4c8d-a9ae-2550f6865ca7" status: 404 len: 109 microversion: 2.1 time: 0.108840 Nov 28 06:43:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 111/323] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 06:43:30 2023] PUT /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580/os-volume_attachments/91aae7ac-132a-4c8d-a9ae-2550f6865ca7 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 06:43:34 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:43:34 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:34 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:34 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:43:34 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6647d9c1-f207-4089-81ce-c0cb672c7151 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580" status: 204 len: 0 microversion: 2.1 time: 0.176201 Nov 28 06:43:34 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 106/324] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:43:34 2023] DELETE /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:43:34 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-a969d8ea-509a-4cc1-99a5-3c5c00365f9a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:34 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-a969d8ea-509a-4cc1-99a5-3c5c00365f9a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a969d8ea-509a-4cc1-99a5-3c5c00365f9a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a969d8ea-509a-4cc1-99a5-3c5c00365f9a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a969d8ea-509a-4cc1-99a5-3c5c00365f9a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a969d8ea-509a-4cc1-99a5-3c5c00365f9a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a969d8ea-509a-4cc1-99a5-3c5c00365f9a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a969d8ea-509a-4cc1-99a5-3c5c00365f9a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:34 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-a969d8ea-509a-4cc1-99a5-3c5c00365f9a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8b23eae758490a8a2476797479f208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c265a98d205f4b679d3a810b4745691a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-a969d8ea-509a-4cc1-99a5-3c5c00365f9a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580" status: 200 len: 1500 microversion: 2.1 time: 0.350852 Nov 28 06:43:34 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 108/325] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:34 2023] GET /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580 => generated 1500 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:43:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f30c00-ea3c-445c-b0c9-5ef899412580", "name": "network-vif-unplugged", "status": "completed", "tag": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] Creating event network-vif-unplugged:1cc3fcfe-307b-49f6-bb59-b8b33aa7764a for instance 93f30c00-ea3c-445c-b0c9-5ef899412580 on user Nov 28 06:43:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-da0a5199-46d8-4744-8223-a834b5315b06 req-a625eaac-b2f1-448e-87b0-a79b29c8944c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042503 Nov 28 06:43:35 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 112/326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:35 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-254217302", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5"}]}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:35 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:35 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] [instance: 70280af1-c742-4096-9abc-7a1ca9b44079] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:35 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] HTTP exception thrown: Instance 70280af1-c742-4096-9abc-7a1ca9b44079 could not be found. Nov 28 06:43:35 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Returning 404 to user: Instance 70280af1-c742-4096-9abc-7a1ca9b44079 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:43:35 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9bbe73e4-873e-48e7-bb26-fc4e30dffcd3 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079" status: 404 len: 111 microversion: 2.93 time: 0.195442 Nov 28 06:43:35 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 107/327] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:43:35 2023] GET /compute/v2.1/servers/70280af1-c742-4096-9abc-7a1ca9b44079 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:43:35 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] validate_networks() for [('75e59e8a-c99e-4ec7-b7de-3ec74a6d06b5', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:43:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4d743731-9b88-4c8c-aea7-39f44cc061c6 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] Calling method '.version_select at 0x7f0b03cd89d0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4d743731-9b88-4c8c-aea7-39f44cc061c6 tempest-ServerActionsV293TestJSON-960022347 tempest-ServerActionsV293TestJSON-960022347-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-885228878" status: 204 len: 0 microversion: 2.93 time: 0.031849 Nov 28 06:43:35 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 113/328] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 28 06:43:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-885228878 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Getting quotas for project aa4536fef53e47e4aac07b82ff452fd6. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Getting quotas for user 65a520d2b45446098b6b97532a696bd8 and project aa4536fef53e47e4aac07b82ff452fd6. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:43:36 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:43:36 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-4a8e7eca-7420-480e-bc83-1705a1aa36e8 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.108544 Nov 28 06:43:36 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 109/329] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:43:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:43:36 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c97485db-e4f0-410a-85f8-d38999f8e01a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:36 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c97485db-e4f0-410a-85f8-d38999f8e01a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:36 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-c97485db-e4f0-410a-85f8-d38999f8e01a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a520d2b45446098b6b97532a696bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4536fef53e47e4aac07b82ff452fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:36 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c97485db-e4f0-410a-85f8-d38999f8e01a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd" status: 200 len: 1206 microversion: 2.1 time: 0.132001 Nov 28 06:43:36 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 108/330] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:36 2023] GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd => generated 1206 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:43:37 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f30c00-ea3c-445c-b0c9-5ef899412580", "name": "network-vif-plugged", "status": "completed", "tag": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a"}, {"server_uuid": "93f30c00-ea3c-445c-b0c9-5ef899412580", "name": "network-vif-deleted", "tag": "1cc3fcfe-307b-49f6-bb59-b8b33aa7764a"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:37 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] Creating event network-vif-plugged:1cc3fcfe-307b-49f6-bb59-b8b33aa7764a for instance 93f30c00-ea3c-445c-b0c9-5ef899412580 on user Nov 28 06:43:37 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] Creating event network-vif-deleted:1cc3fcfe-307b-49f6-bb59-b8b33aa7764a for instance 93f30c00-ea3c-445c-b0c9-5ef899412580 on user Nov 28 06:43:37 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-b96f8998-493e-4040-8e8f-bb168c127485 req-89502944-271e-419c-81a2-fe5dae21044e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038024 Nov 28 06:43:37 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 114/331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:39 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25781b03-ef60-44cd-aab8-5f5b3350b8fd", "tag": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] Creating event network-changed:6e4a143d-6a3f-45dc-955f-f6be6c3918ae for instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd on user Nov 28 06:43:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-f305b584-2013-4174-b0ad-c8d8311de8ad req-c3afe110-4ae2-49bd-8587-e18584a300f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049671 Nov 28 06:43:39 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 110/332] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:42 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25781b03-ef60-44cd-aab8-5f5b3350b8fd", "name": "network-vif-plugged", "status": "completed", "tag": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:42 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] Creating event network-vif-plugged:6e4a143d-6a3f-45dc-955f-f6be6c3918ae for instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd on user Nov 28 06:43:42 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-35e31f71-0a16-49a2-9fd3-a1b2d595fa1c req-1da0529f-af7a-42e1-b769-941805e084f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039839 Nov 28 06:43:42 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 109/333] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:44 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25781b03-ef60-44cd-aab8-5f5b3350b8fd", "name": "network-vif-plugged", "status": "completed", "tag": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:44 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] Creating event network-vif-plugged:6e4a143d-6a3f-45dc-955f-f6be6c3918ae for instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd on user Nov 28 06:43:44 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-ba33e9bd-20cb-43c8-bd45-3c4556ca077f req-928b397f-cdda-425a-ade1-09e7d0aa1d8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049435 Nov 28 06:43:44 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 115/334] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:43:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-2ce1ae88-5b8c-4b67-a9d3-a328e5a27c6f tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-2ce1ae88-5b8c-4b67-a9d3-a328e5a27c6f tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ce1ae88-5b8c-4b67-a9d3-a328e5a27c6f tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ce1ae88-5b8c-4b67-a9d3-a328e5a27c6f tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ce1ae88-5b8c-4b67-a9d3-a328e5a27c6f tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ce1ae88-5b8c-4b67-a9d3-a328e5a27c6f tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ce1ae88-5b8c-4b67-a9d3-a328e5a27c6f tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2ce1ae88-5b8c-4b67-a9d3-a328e5a27c6f tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:48 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-2ce1ae88-5b8c-4b67-a9d3-a328e5a27c6f tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:48 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-2ce1ae88-5b8c-4b67-a9d3-a328e5a27c6f tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1" status: 200 len: 1488 microversion: 2.1 time: 0.544695 Nov 28 06:43:48 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 111/335] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:48 2023] GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1 => generated 1488 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:43:49 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:43:49 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a1567a43-38ea-4832-a023-ca8aeb9ddadd tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-981116351", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f296a505-6fd2-4b01-9695-183d56d0fc11", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:43:49 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-a1567a43-38ea-4832-a023-ca8aeb9ddadd tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] HTTP exception thrown: Block Device f296a505-6fd2-4b01-9695-183d56d0fc11 is not bootable. Nov 28 06:43:49 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a1567a43-38ea-4832-a023-ca8aeb9ddadd tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Returning 400 to user: Block Device f296a505-6fd2-4b01-9695-183d56d0fc11 is not bootable. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:43:49 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a1567a43-38ea-4832-a023-ca8aeb9ddadd tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.090178 Nov 28 06:43:49 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 110/336] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:43:49 2023] POST /compute/v2.1/servers => generated 110 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:43:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7e4bebd1-0e39-4dc0-9fb1-9a9183f7028b tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:49 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7e4bebd1-0e39-4dc0-9fb1-9a9183f7028b tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7e4bebd1-0e39-4dc0-9fb1-9a9183f7028b tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7e4bebd1-0e39-4dc0-9fb1-9a9183f7028b tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7e4bebd1-0e39-4dc0-9fb1-9a9183f7028b tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7e4bebd1-0e39-4dc0-9fb1-9a9183f7028b tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7e4bebd1-0e39-4dc0-9fb1-9a9183f7028b tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7e4bebd1-0e39-4dc0-9fb1-9a9183f7028b tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:50 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-7e4bebd1-0e39-4dc0-9fb1-9a9183f7028b tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7e4bebd1-0e39-4dc0-9fb1-9a9183f7028b tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" status: 200 len: 1491 microversion: 2.1 time: 0.266936 Nov 28 06:43:50 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 116/337] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:43:49 2023] GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e => generated 1491 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:59 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:43:59 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-b2d7b0e8-6a71-47dd-acee-907b2a511887 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5" status: 200 len: 1756 microversion: 2.87 time: 0.321788 Nov 28 06:43:59 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 112/338] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:43:59 2023] GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5 => generated 1756 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:44:04 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:04 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:04 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c494d534-1284-4bfe-bfb6-d41693d12172 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:04 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c494d534-1284-4bfe-bfb6-d41693d12172 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c494d534-1284-4bfe-bfb6-d41693d12172 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c494d534-1284-4bfe-bfb6-d41693d12172 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c494d534-1284-4bfe-bfb6-d41693d12172 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c494d534-1284-4bfe-bfb6-d41693d12172 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c494d534-1284-4bfe-bfb6-d41693d12172 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c494d534-1284-4bfe-bfb6-d41693d12172 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c494d534-1284-4bfe-bfb6-d41693d12172 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054215 Nov 28 06:44:04 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 111/339] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:44:04 2023] GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:04 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:44:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-df8e2794-201c-4dfd-ba9a-e201dd65e75d tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433" status: 204 len: 0 microversion: 2.1 time: 0.389841 Nov 28 06:44:04 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 117/340] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:44:04 2023] DELETE /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:44:04 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-68bd4543-7735-44c8-9b2e-34d278a09e49 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:04 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-68bd4543-7735-44c8-9b2e-34d278a09e49 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-68bd4543-7735-44c8-9b2e-34d278a09e49 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-68bd4543-7735-44c8-9b2e-34d278a09e49 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-68bd4543-7735-44c8-9b2e-34d278a09e49 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-68bd4543-7735-44c8-9b2e-34d278a09e49 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-68bd4543-7735-44c8-9b2e-34d278a09e49 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-68bd4543-7735-44c8-9b2e-34d278a09e49 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:05 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-68bd4543-7735-44c8-9b2e-34d278a09e49 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-68bd4543-7735-44c8-9b2e-34d278a09e49 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433" status: 200 len: 1668 microversion: 2.1 time: 0.192001 Nov 28 06:44:05 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 113/341] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:04 2023] GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433 => generated 1668 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:05 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4802806-6422-46da-8d0f-5674af0a8433", "name": "network-vif-unplugged", "status": "completed", "tag": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:05 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] Creating event network-vif-unplugged:1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance b4802806-6422-46da-8d0f-5674af0a8433 on user Nov 28 06:44:05 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-9288ee6c-04f6-475f-b2ba-6506a8401d95 req-7fb088f4-cc1f-47cb-804c-3529ac569c72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.026937 Nov 28 06:44:05 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 112/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-2b82ee10-81b1-4f49-97de-ab80bedea1e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:06 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-2b82ee10-81b1-4f49-97de-ab80bedea1e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b82ee10-81b1-4f49-97de-ab80bedea1e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b82ee10-81b1-4f49-97de-ab80bedea1e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b82ee10-81b1-4f49-97de-ab80bedea1e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b82ee10-81b1-4f49-97de-ab80bedea1e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b82ee10-81b1-4f49-97de-ab80bedea1e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b82ee10-81b1-4f49-97de-ab80bedea1e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:07 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-2b82ee10-81b1-4f49-97de-ab80bedea1e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3ace56f1264298944b8b765f51417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11f8db963684cba9927a06dfb035bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:07 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-2b82ee10-81b1-4f49-97de-ab80bedea1e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972" status: 200 len: 1546 microversion: 2.1 time: 0.272090 Nov 28 06:44:07 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 118/343] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:06 2023] GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972 => generated 1546 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:07 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-f7f3bf22-1a1c-4412-a5c1-40bcfa45547c req-a2a8a472-2646-47fb-a8e2-fc1ff955009a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4802806-6422-46da-8d0f-5674af0a8433", "name": "network-vif-deleted", "tag": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f7f3bf22-1a1c-4412-a5c1-40bcfa45547c req-a2a8a472-2646-47fb-a8e2-fc1ff955009a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f7f3bf22-1a1c-4412-a5c1-40bcfa45547c req-a2a8a472-2646-47fb-a8e2-fc1ff955009a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f7f3bf22-1a1c-4412-a5c1-40bcfa45547c req-a2a8a472-2646-47fb-a8e2-fc1ff955009a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:07 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-f7f3bf22-1a1c-4412-a5c1-40bcfa45547c req-a2a8a472-2646-47fb-a8e2-fc1ff955009a service nova] Creating event network-vif-deleted:1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance b4802806-6422-46da-8d0f-5674af0a8433 on user Nov 28 06:44:07 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-f7f3bf22-1a1c-4412-a5c1-40bcfa45547c req-a2a8a472-2646-47fb-a8e2-fc1ff955009a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035151 Nov 28 06:44:07 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 114/344] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:07 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4802806-6422-46da-8d0f-5674af0a8433", "name": "network-vif-plugged", "status": "completed", "tag": "1a2f08f7-ca07-4148-a3d9-a9034157bd6a"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:07 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] Creating event network-vif-plugged:1a2f08f7-ca07-4148-a3d9-a9034157bd6a for instance b4802806-6422-46da-8d0f-5674af0a8433 on user Nov 28 06:44:07 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-d23a6e3c-8b06-41d7-a69a-01b7cec80c66 req-af9c03a6-a7cc-4be0-a1a7-60ea6e5f9d9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027887 Nov 28 06:44:07 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 113/345] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5c156035-2ce9-4067-9558-60f504417c3e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:08 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-5c156035-2ce9-4067-9558-60f504417c3e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5c156035-2ce9-4067-9558-60f504417c3e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5c156035-2ce9-4067-9558-60f504417c3e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5c156035-2ce9-4067-9558-60f504417c3e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5c156035-2ce9-4067-9558-60f504417c3e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5c156035-2ce9-4067-9558-60f504417c3e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5c156035-2ce9-4067-9558-60f504417c3e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:09 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-5c156035-2ce9-4067-9558-60f504417c3e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73373ee05e1b4e09b5c0870750a77262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cff8da56da484d9dfee1b8118474b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-5c156035-2ce9-4067-9558-60f504417c3e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" status: 200 len: 1534 microversion: 2.1 time: 0.225726 Nov 28 06:44:09 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 119/346] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:08 2023] GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c => generated 1534 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:09 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:09 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-b3ecea07-eafc-4476-8ab5-8b6a12c6118e tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "POST /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7/action" status: 202 len: 0 microversion: 2.1 time: 0.395330 Nov 28 06:44:09 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 115/347] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:44:09 2023] POST /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:44:09 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-17bb946b-ff38-4514-a260-37a8de4b6a92 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:09 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-17bb946b-ff38-4514-a260-37a8de4b6a92 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-17bb946b-ff38-4514-a260-37a8de4b6a92 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-17bb946b-ff38-4514-a260-37a8de4b6a92 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-17bb946b-ff38-4514-a260-37a8de4b6a92 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-17bb946b-ff38-4514-a260-37a8de4b6a92 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-17bb946b-ff38-4514-a260-37a8de4b6a92 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-17bb946b-ff38-4514-a260-37a8de4b6a92 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:10 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-17bb946b-ff38-4514-a260-37a8de4b6a92 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:10 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-17bb946b-ff38-4514-a260-37a8de4b6a92 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1711 microversion: 2.1 time: 0.455792 Nov 28 06:44:10 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 114/348] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:09 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1711 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:10 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-unplugged", "status": "completed", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] Creating event network-vif-unplugged:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:44:10 user devstack@n-api.service[64872]: DEBUG nova.compute.api [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:44:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-97132e89-e8b1-4783-830d-39d7da7cfa04 req-49bde2e8-369e-4441-b149-2629fad1beea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046213 Nov 28 06:44:10 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 120/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-plugged", "status": "completed", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] Creating event network-vif-plugged:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:44:12 user devstack@n-api.service[64873]: DEBUG nova.compute.api [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64873) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:44:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e44784ed-e949-4ace-be0e-49b1f5b919f9 req-a53b365f-d472-42f4-b337-10468cb929fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062583 Nov 28 06:44:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 116/350] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:15 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-58591af7-d685-4aed-b845-a29228aeb2ec tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/action" status: 202 len: 0 microversion: 2.1 time: 0.073118 Nov 28 06:44:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 115/351] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:44:15 2023] POST /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:44:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-161f4292-c0ca-4081-b8d0-52119edc9e91 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:15 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-161f4292-c0ca-4081-b8d0-52119edc9e91 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-161f4292-c0ca-4081-b8d0-52119edc9e91 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-161f4292-c0ca-4081-b8d0-52119edc9e91 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-161f4292-c0ca-4081-b8d0-52119edc9e91 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-161f4292-c0ca-4081-b8d0-52119edc9e91 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-161f4292-c0ca-4081-b8d0-52119edc9e91 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-161f4292-c0ca-4081-b8d0-52119edc9e91 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-161f4292-c0ca-4081-b8d0-52119edc9e91 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.233267 Nov 28 06:44:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 121/352] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:44:15 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-interface => generated 282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-unplugged", "status": "completed", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] Creating event network-vif-unplugged:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:44:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-65df08ad-5b2d-4fa8-b762-047ae9349e99 req-9482fbd5-395a-472d-9c7b-6ec910cab9a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030824 Nov 28 06:44:16 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 117/353] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:16 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] Creating event network-changed:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:44:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-93d634a5-2e7d-448a-80db-b2f7cec60138 req-9cd8fcb4-4728-4b40-9b73-122485887870 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165915 Nov 28 06:44:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 116/354] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:18 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-plugged", "status": "completed", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] Creating event network-vif-plugged:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:44:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-6ddb0c8b-c81f-4cc3-9d9a-3b19cfcc0a2b req-80e74463-ad25-4879-8f06-2c1da49ed7b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051087 Nov 28 06:44:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 122/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] Creating event network-changed:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:44:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-bda9460c-96f1-4565-92da-ff232116d177 req-4ee894b7-6744-43a9-b928-996b7e388c8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032082 Nov 28 06:44:18 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 118/356] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:20 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-plugged", "status": "completed", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}, {"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-plugged", "status": "completed", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Creating event network-vif-plugged:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:44:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] Creating event network-vif-plugged:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:44:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-d54f9e14-a45b-4f3d-a345-359c96bc51c5 req-1613429c-873b-4b4c-9e96-c2a01c690015 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031408 Nov 28 06:44:20 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 117/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:24 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-plugged", "status": "completed", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:24 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] Creating event network-vif-plugged:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:44:24 user devstack@n-api.service[64872]: DEBUG nova.compute.api [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:44:24 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-6febd748-1e52-4d59-abc4-006a3c97709c req-36629ad9-fa5e-4705-a2a5-bd4c3b60da7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045424 Nov 28 06:44:24 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 123/358] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:25 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:25 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 93f30c00-ea3c-445c-b0c9-5ef899412580] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] HTTP exception thrown: Instance 93f30c00-ea3c-445c-b0c9-5ef899412580 could not be found. Nov 28 06:44:25 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Returning 404 to user: Instance 93f30c00-ea3c-445c-b0c9-5ef899412580 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:44:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-73dc191a-516f-4603-a3c5-0195f30d1220 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580" status: 404 len: 111 microversion: 2.1 time: 0.037343 Nov 28 06:44:25 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 119/359] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:25 2023] GET /compute/v2.1/servers/93f30c00-ea3c-445c-b0c9-5ef899412580 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 06:44:26 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-plugged", "status": "completed", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:26 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] Creating event network-vif-plugged:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:44:26 user devstack@n-api.service[64871]: DEBUG nova.compute.api [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:44:26 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-6bdc970f-3400-4be4-9970-8209d2a2e5c7 req-415df9fb-7579-4e84-9679-691d3cf46d14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038503 Nov 28 06:44:26 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 118/360] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:26 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-dd9623ed-73d3-4f34-95b8-8953c675852a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:26 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-dd9623ed-73d3-4f34-95b8-8953c675852a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dd9623ed-73d3-4f34-95b8-8953c675852a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dd9623ed-73d3-4f34-95b8-8953c675852a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dd9623ed-73d3-4f34-95b8-8953c675852a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dd9623ed-73d3-4f34-95b8-8953c675852a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dd9623ed-73d3-4f34-95b8-8953c675852a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dd9623ed-73d3-4f34-95b8-8953c675852a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:27 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-dd9623ed-73d3-4f34-95b8-8953c675852a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a520d2b45446098b6b97532a696bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4536fef53e47e4aac07b82ff452fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-dd9623ed-73d3-4f34-95b8-8953c675852a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd" status: 200 len: 1487 microversion: 2.1 time: 0.348355 Nov 28 06:44:27 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 124/361] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:26 2023] GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd => generated 1487 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:29 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:29 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:29 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:44:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-ec2713f6-bcc0-4576-bb0c-cbb8b164e002 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b" status: 204 len: 0 microversion: 2.1 time: 0.149402 Nov 28 06:44:29 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 120/362] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:44:29 2023] DELETE /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:44:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-297becb1-5c05-4517-8df4-74d76294abe8 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:29 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-297becb1-5c05-4517-8df4-74d76294abe8 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297becb1-5c05-4517-8df4-74d76294abe8 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297becb1-5c05-4517-8df4-74d76294abe8 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297becb1-5c05-4517-8df4-74d76294abe8 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297becb1-5c05-4517-8df4-74d76294abe8 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297becb1-5c05-4517-8df4-74d76294abe8 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297becb1-5c05-4517-8df4-74d76294abe8 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:29 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-930d0d58-f367-4213-9c66-132bce8e726d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:29 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-930d0d58-f367-4213-9c66-132bce8e726d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-930d0d58-f367-4213-9c66-132bce8e726d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-930d0d58-f367-4213-9c66-132bce8e726d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-930d0d58-f367-4213-9c66-132bce8e726d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-930d0d58-f367-4213-9c66-132bce8e726d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-930d0d58-f367-4213-9c66-132bce8e726d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-930d0d58-f367-4213-9c66-132bce8e726d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:29 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-930d0d58-f367-4213-9c66-132bce8e726d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.220726 Nov 28 06:44:29 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 125/363] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:44:29 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7/os-interface => generated 282 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:30 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636fad3b-617f-4a65-8cf7-ef67fd68304b", "name": "network-vif-unplugged", "status": "completed", "tag": "519d15c3-a87c-436b-aa7d-b6754a055382"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:30 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] Creating event network-vif-unplugged:519d15c3-a87c-436b-aa7d-b6754a055382 for instance 636fad3b-617f-4a65-8cf7-ef67fd68304b on user Nov 28 06:44:30 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-d2538877-882d-4303-b838-4e688ea1383c req-971a3567-f588-421f-92da-3c6ebb1be6d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058192 Nov 28 06:44:30 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-297becb1-5c05-4517-8df4-74d76294abe8 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8b23eae758490a8a2476797479f208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c265a98d205f4b679d3a810b4745691a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:30 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 121/364] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:30 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-297becb1-5c05-4517-8df4-74d76294abe8 tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b" status: 200 len: 1667 microversion: 2.1 time: 0.507837 Nov 28 06:44:30 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 119/365] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:29 2023] GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b => generated 1667 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:44:31 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e69254a-5914-4e90-ae6e-bdf28ac716e7", "tag": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] Creating event network-changed:29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 on user Nov 28 06:44:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-65fe3ec7-b8e0-4d65-adf8-9fbaaa258a96 req-6fff194e-6cef-4918-b3c6-7379c0f6500c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031682 Nov 28 06:44:31 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 126/366] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:31 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d123d7b9-9018-429d-807b-081ca5b82093 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:31 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d123d7b9-9018-429d-807b-081ca5b82093 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d123d7b9-9018-429d-807b-081ca5b82093 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d123d7b9-9018-429d-807b-081ca5b82093 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d123d7b9-9018-429d-807b-081ca5b82093 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d123d7b9-9018-429d-807b-081ca5b82093 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d123d7b9-9018-429d-807b-081ca5b82093 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d123d7b9-9018-429d-807b-081ca5b82093 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:31 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-d123d7b9-9018-429d-807b-081ca5b82093 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d123d7b9-9018-429d-807b-081ca5b82093 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1540 microversion: 2.1 time: 0.765402 Nov 28 06:44:31 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 122/367] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:31 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1540 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:31 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-bf2af8d8-718c-4ae8-8009-c6527c54db84 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:31 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-bf2af8d8-718c-4ae8-8009-c6527c54db84 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf2af8d8-718c-4ae8-8009-c6527c54db84 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf2af8d8-718c-4ae8-8009-c6527c54db84 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf2af8d8-718c-4ae8-8009-c6527c54db84 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf2af8d8-718c-4ae8-8009-c6527c54db84 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf2af8d8-718c-4ae8-8009-c6527c54db84 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf2af8d8-718c-4ae8-8009-c6527c54db84 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:32 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636fad3b-617f-4a65-8cf7-ef67fd68304b", "name": "network-vif-plugged", "status": "completed", "tag": "519d15c3-a87c-436b-aa7d-b6754a055382"}, {"server_uuid": "636fad3b-617f-4a65-8cf7-ef67fd68304b", "name": "network-vif-deleted", "tag": "519d15c3-a87c-436b-aa7d-b6754a055382"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] Creating event network-vif-plugged:519d15c3-a87c-436b-aa7d-b6754a055382 for instance 636fad3b-617f-4a65-8cf7-ef67fd68304b on user Nov 28 06:44:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] Creating event network-vif-deleted:519d15c3-a87c-436b-aa7d-b6754a055382 for instance 636fad3b-617f-4a65-8cf7-ef67fd68304b on user Nov 28 06:44:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-d48bc5b8-fc78-4c34-88ef-393b543e092b req-faa50b07-f4bb-488a-b645-7c1879e0701a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039077 Nov 28 06:44:32 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 127/368] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:32 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-bf2af8d8-718c-4ae8-8009-c6527c54db84 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-bf2af8d8-718c-4ae8-8009-c6527c54db84 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1540 microversion: 2.1 time: 0.296546 Nov 28 06:44:32 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 120/369] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:31 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1540 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:44 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:44 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:44 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0d45414f-a7bf-47b4-ab6d-fce8d20249e5 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Action: 'create', calling method: .version_select at 0x7f0b03a9af80>, body: {"keypair": {"name": "tempest-keypair-676620164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr34jTxAgvpieMtESUKF9pO7y0EurVjqQ9xjdMeLwnzjkjuKNQ7iJVoSBKNvYBZIPKIBEj492DjxQnvCzD9J0jWg2c7JEs+zpI2+Oeup3XvLPpb0ZWo5Jl60bq3TCKyvA=="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:44 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-0d45414f-a7bf-47b4-ab6d-fce8d20249e5 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Getting quotas for project 8bc4dd85b0ff45bd8e13a8266b18b843. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:44:44 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-0d45414f-a7bf-47b4-ab6d-fce8d20249e5 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Getting quotas for user 5cff054e141e43feb19997a67027f5bc and project 8bc4dd85b0ff45bd8e13a8266b18b843. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:44:44 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0d45414f-a7bf-47b4-ab6d-fce8d20249e5 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.162079 Nov 28 06:44:44 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 123/370] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:44:43 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:44:45 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachScenarioOldVersion-server-1285664283", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "e43b9224-8ed8-407f-9685-ee32b4909c3b"}], "security_groups": [{"name": "tempest-securitygroup--2116547106"}], "key_name": "tempest-keypair-676620164", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:45 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:45 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:45 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] validate_networks() for [('e43b9224-8ed8-407f-9685-ee32b4909c3b', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Getting quotas for project 8bc4dd85b0ff45bd8e13a8266b18b843. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Getting quotas for user 5cff054e141e43feb19997a67027f5bc and project 8bc4dd85b0ff45bd8e13a8266b18b843. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:44:46 user devstack@n-api.service[64872]: WARNING nova.utils [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Hostname tempest-TestServerVolumeAttachScenarioOldVersion-server-1285664283 is longer than 63, truncate it to tempest-TestServerVolumeAttachScenarioOldVersion-server-1285664 Nov 28 06:44:46 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:44:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-2b282b9e-3743-4d3a-8461-407a558dafd4 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.549814 Nov 28 06:44:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 128/371] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:44:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:44:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6ec225d8-8ca7-4193-8f7d-1affc1432cfe tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:46 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6ec225d8-8ca7-4193-8f7d-1affc1432cfe tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:46 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=20 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:46 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:46 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-6ec225d8-8ca7-4193-8f7d-1affc1432cfe tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cff054e141e43feb19997a67027f5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc4dd85b0ff45bd8e13a8266b18b843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6ec225d8-8ca7-4193-8f7d-1affc1432cfe tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10" status: 200 len: 1249 microversion: 2.1 time: 0.065530 Nov 28 06:44:46 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 121/372] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:46 2023] GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10 => generated 1249 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:48 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:48 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:48 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lazy-loading 'services' on Instance uuid 0e5b898b-f5f0-4504-94d0-53bf8d622620 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:44:48 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-28afbf3f-b8ac-4080-89ff-e893a9c63a4b tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-volume_attachments/7a1e0169-c086-4acb-a496-a8a00aaeca65" status: 202 len: 0 microversion: 2.1 time: 0.171635 Nov 28 06:44:48 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 124/373] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:44:48 2023] DELETE /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-volume_attachments/7a1e0169-c086-4acb-a496-a8a00aaeca65 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:44:48 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b4fccdba-548c-4b8c-9045-789625e8793f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:48 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-b4fccdba-548c-4b8c-9045-789625e8793f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b4fccdba-548c-4b8c-9045-789625e8793f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b4fccdba-548c-4b8c-9045-789625e8793f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b4fccdba-548c-4b8c-9045-789625e8793f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b4fccdba-548c-4b8c-9045-789625e8793f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b4fccdba-548c-4b8c-9045-789625e8793f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b4fccdba-548c-4b8c-9045-789625e8793f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:48 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b4fccdba-548c-4b8c-9045-789625e8793f tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048658 Nov 28 06:44:48 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 129/374] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:44:48 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:48 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3a1360-d402-4962-9b05-ca0288480b10", "tag": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] Creating event network-changed:a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance cb3a1360-d402-4962-9b05-ca0288480b10 on user Nov 28 06:44:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-cf4e94c5-b215-4e3a-9bbb-86ba10e5743b req-e41d5860-da40-4ca1-9068-4029379726f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041003 Nov 28 06:44:48 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 122/375] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccd4a9c5-66a7-4463-91ee-e7d35f4ff261"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:49 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 while it is in vm_state rescued Nov 28 06:44:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Returning 409 to user: Cannot 'attach_volume' instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 while it is in vm_state rescued {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:44:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e9df2602-baf5-48b2-a7d8-98eafe00ce83 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039865 Nov 28 06:44:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 125/376] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:44:49 2023] POST /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 28 06:44:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:49 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f6459dfc-068d-4853-bc1b-f83941551cdc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1/action" status: 202 len: 0 microversion: 2.1 time: 0.084973 Nov 28 06:44:49 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 130/377] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:44:49 2023] POST /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:44:49 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-83dd14cb-0772-4da3-a94d-f531060271b7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:49 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-83dd14cb-0772-4da3-a94d-f531060271b7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83dd14cb-0772-4da3-a94d-f531060271b7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83dd14cb-0772-4da3-a94d-f531060271b7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83dd14cb-0772-4da3-a94d-f531060271b7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83dd14cb-0772-4da3-a94d-f531060271b7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83dd14cb-0772-4da3-a94d-f531060271b7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83dd14cb-0772-4da3-a94d-f531060271b7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:49 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-83dd14cb-0772-4da3-a94d-f531060271b7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:49 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-83dd14cb-0772-4da3-a94d-f531060271b7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1" status: 200 len: 1496 microversion: 2.1 time: 0.670416 Nov 28 06:44:49 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 123/378] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:49 2023] GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1 => generated 1496 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:50 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-df5c26c0-b070-4590-9b81-e54361ca6237 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:50 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-df5c26c0-b070-4590-9b81-e54361ca6237 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df5c26c0-b070-4590-9b81-e54361ca6237 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df5c26c0-b070-4590-9b81-e54361ca6237 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df5c26c0-b070-4590-9b81-e54361ca6237 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df5c26c0-b070-4590-9b81-e54361ca6237 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df5c26c0-b070-4590-9b81-e54361ca6237 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df5c26c0-b070-4590-9b81-e54361ca6237 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:50 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-df5c26c0-b070-4590-9b81-e54361ca6237 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:50 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-unplugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:50 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-df5c26c0-b070-4590-9b81-e54361ca6237 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" status: 200 len: 1491 microversion: 2.1 time: 0.216596 Nov 28 06:44:50 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 126/379] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:50 2023] GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e => generated 1491 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] Creating event network-vif-unplugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:44:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-55b94537-f945-4e90-ad8a-cf0e22df3669 req-80485eba-d68a-4ce0-a9d3-c0bf3a74e441 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034034 Nov 28 06:44:50 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 131/380] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:51 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3a1360-d402-4962-9b05-ca0288480b10", "name": "network-vif-plugged", "status": "completed", "tag": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:51 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] Creating event network-vif-plugged:a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance cb3a1360-d402-4962-9b05-ca0288480b10 on user Nov 28 06:44:51 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-ebfa9d09-3b9a-42f0-ba15-9eb48df0901a req-7c3e7edd-4a35-454c-988c-5b423c9d1694 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035697 Nov 28 06:44:51 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 124/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:52 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-plugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] Creating event network-vif-plugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:44:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-88de6dab-e98c-4736-a176-1f7ba0bc8d15 req-0e2b35c6-b631-4ba7-8c3a-0c34f2b3d6aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030759 Nov 28 06:44:52 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 127/382] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:53 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3a1360-d402-4962-9b05-ca0288480b10", "name": "network-vif-plugged", "status": "completed", "tag": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] Creating event network-vif-plugged:a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance cb3a1360-d402-4962-9b05-ca0288480b10 on user Nov 28 06:44:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-186c4aa2-ac3d-4b5b-a46d-e696bb28e736 req-ec63eac4-1708-4516-9572-6194d68390b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028992 Nov 28 06:44:53 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 132/383] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-plugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}, {"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-plugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Creating event network-vif-plugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:44:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] Creating event network-vif-plugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:44:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-be826d10-92fd-4c67-8eaa-516969ab6474 req-5ae0606d-3176-4771-ae87-bcb5758d69aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043828 Nov 28 06:44:54 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 125/384] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:44:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:44:55 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:55 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance b4802806-6422-46da-8d0f-5674af0a8433 could not be found. Nov 28 06:44:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance b4802806-6422-46da-8d0f-5674af0a8433 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:44:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-fe8d630e-8dad-4e82-990f-1a559636606f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433" status: 404 len: 111 microversion: 2.1 time: 0.065143 Nov 28 06:44:55 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:55 2023] GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:44:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-14412c54-312c-448f-861a-b2475d2e14fe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '.version_select at 0x7f0b03d108b0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-14412c54-312c-448f-861a-b2475d2e14fe tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894833367" status: 202 len: 0 microversion: 2.1 time: 0.028143 Nov 28 06:44:55 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 133/386] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 06:44:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894833367 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:44:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-67d75eca-1b70-4508-95fc-e29fad38141b tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: .version_select at 0x7f0b03a700d0>, body: {"keypair": {"name": "tempest-keypair-1434653657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb8WB6ij2s6GSTONUry95+XZmirnDSuGCLeYTlWhJo5pt46o5jzKSFOUsahma8KL6J42jbZN/OQdWkzrX5NrqDyqs21eSDp1KFumAwGYgOU0L1gYwgX4rEZDxatlltO6w=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:55 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-67d75eca-1b70-4508-95fc-e29fad38141b tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for project 5df9ec769206481e8dad48a6461c46ba. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:44:55 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-67d75eca-1b70-4508-95fc-e29fad38141b tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for user 05e396090c4b4a8995d8d2e66c8b3db0 and project 5df9ec769206481e8dad48a6461c46ba. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:44:56 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-67d75eca-1b70-4508-95fc-e29fad38141b tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120697 Nov 28 06:44:56 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 126/387] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:44:55 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:44:57 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-875010330", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "202f7756-ce64-4307-8a6b-b7601305e6b7"}], "security_groups": [{"name": "tempest-securitygroup--1181066707"}], "key_name": "tempest-keypair-1434653657", "user_data": "}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:57 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] validate_networks() for [('202f7756-ce64-4307-8a6b-b7601305e6b7', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for project 5df9ec769206481e8dad48a6461c46ba. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for user 05e396090c4b4a8995d8d2e66c8b3db0 and project 5df9ec769206481e8dad48a6461c46ba. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:44:58 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:44:58 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-dfa3965f-475e-4895-89f5-1dfd417b4026 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.621551 Nov 28 06:44:58 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 129/388] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:44:57 2023] POST /compute/v2.1/servers => generated 400 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:44:58 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:58 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:44:58 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-8bc27f16-8caf-4020-b023-b494074b4483 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:58 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-8bc27f16-8caf-4020-b023-b494074b4483 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:58 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-8bc27f16-8caf-4020-b023-b494074b4483 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:44:58 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-8bc27f16-8caf-4020-b023-b494074b4483 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" status: 200 len: 1233 microversion: 2.1 time: 0.110595 Nov 28 06:44:58 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 134/389] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:44:58 2023] GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa => generated 1233 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:44:59 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:44:59 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:59 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ce533f58-3609-4262-9b25-2c14fa910541 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5/action" status: 202 len: 0 microversion: 2.87 time: 0.081322 Nov 28 06:44:59 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 127/390] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 06:44:59 2023] POST /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:44:59 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:44:59 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:44:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:44:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:44:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:44:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4002e4d1-6664-4649-9dff-b4826aa67662 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:00 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4002e4d1-6664-4649-9dff-b4826aa67662 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4002e4d1-6664-4649-9dff-b4826aa67662 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4002e4d1-6664-4649-9dff-b4826aa67662 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4002e4d1-6664-4649-9dff-b4826aa67662 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4002e4d1-6664-4649-9dff-b4826aa67662 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4002e4d1-6664-4649-9dff-b4826aa67662 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4002e4d1-6664-4649-9dff-b4826aa67662 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:00 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:00 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:00 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0fa91f29-b1d3-458f-8d9d-5775d1d22711 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5" status: 200 len: 1764 microversion: 2.87 time: 0.308721 Nov 28 06:45:00 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 130/391] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:44:59 2023] GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5 => generated 1764 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:45:00 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-4002e4d1-6664-4649-9dff-b4826aa67662 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4002e4d1-6664-4649-9dff-b4826aa67662 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1704 microversion: 2.1 time: 0.268177 Nov 28 06:45:00 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 135/392] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:00 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1704 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:45:00 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-unplugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] Creating event network-vif-unplugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:45:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-61ece749-14a4-455a-acfa-e039b6c4957b req-14291f7f-9587-4d54-a19e-01dc37c571de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045570 Nov 28 06:45:00 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 128/393] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:01 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa", "tag": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] Creating event network-changed:b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa on user Nov 28 06:45:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-5c163f42-78c8-4071-8917-cf49ce121a3d req-2488ef5b-8dfe-466d-b509-c7a1eed6e996 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036727 Nov 28 06:45:01 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 131/394] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:02 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] Creating event network-vif-plugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:45:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-2e31e7d6-7ae8-483f-8293-551b6697096a req-86c18fc0-ab5e-4d90-8d59-7f3a592e7137 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040184 Nov 28 06:45:02 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 136/395] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:04 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa", "name": "network-vif-plugged", "status": "completed", "tag": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] Creating event network-vif-plugged:b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa on user Nov 28 06:45:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-3d481fe7-6145-4813-a5f2-227794a07e41 req-1ad0cc02-d3bf-4f39-9ab0-7c093f8e7367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029479 Nov 28 06:45:04 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 129/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:04 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}, {"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Creating event network-vif-plugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:45:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] Creating event network-vif-plugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:45:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-408b4e61-530b-40c9-a8ae-0cce2f1e4da2 req-649ce67c-6d79-4fd3-85ed-6c3ef0187d53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038719 Nov 28 06:45:05 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 132/397] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa", "name": "network-vif-plugged", "status": "completed", "tag": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] Creating event network-vif-plugged:b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa on user Nov 28 06:45:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-b365b1a6-fd56-44b5-979b-13ced4728544 req-ae88ccfb-78e4-4c74-998a-0cd705b54b0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039805 Nov 28 06:45:06 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 137/398] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:07 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:07 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-0523a58a-1bfb-4eeb-8556-ad757c6bc28d tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:07 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-0523a58a-1bfb-4eeb-8556-ad757c6bc28d tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0523a58a-1bfb-4eeb-8556-ad757c6bc28d tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0523a58a-1bfb-4eeb-8556-ad757c6bc28d tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0523a58a-1bfb-4eeb-8556-ad757c6bc28d tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0523a58a-1bfb-4eeb-8556-ad757c6bc28d tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0523a58a-1bfb-4eeb-8556-ad757c6bc28d tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0523a58a-1bfb-4eeb-8556-ad757c6bc28d tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:07 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-0523a58a-1bfb-4eeb-8556-ad757c6bc28d tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.220393 Nov 28 06:45:07 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 130/399] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:45:07 2023] GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-interface => generated 282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec477b1-ae4b-4ec0-b396-353c82f38972", "tag": "ea9497df-2959-489f-a6d7-4ce7a474741d"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] Creating event network-changed:ea9497df-2959-489f-a6d7-4ce7a474741d for instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 on user Nov 28 06:45:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-49c2c492-9d48-4b15-8604-3f01eab4fab7 req-8d29c98f-f503-401d-94b0-2f346b3057e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037473 Nov 28 06:45:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 133/400] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:09 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:09 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-2255e90a-d808-4ef7-9723-60fdab947d2c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:09 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-2255e90a-d808-4ef7-9723-60fdab947d2c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2255e90a-d808-4ef7-9723-60fdab947d2c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2255e90a-d808-4ef7-9723-60fdab947d2c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2255e90a-d808-4ef7-9723-60fdab947d2c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2255e90a-d808-4ef7-9723-60fdab947d2c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2255e90a-d808-4ef7-9723-60fdab947d2c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2255e90a-d808-4ef7-9723-60fdab947d2c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:09 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-2255e90a-d808-4ef7-9723-60fdab947d2c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73373ee05e1b4e09b5c0870750a77262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cff8da56da484d9dfee1b8118474b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-2255e90a-d808-4ef7-9723-60fdab947d2c tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" status: 200 len: 1534 microversion: 2.1 time: 0.440904 Nov 28 06:45:09 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 138/401] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:09 2023] GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c => generated 1534 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:45:11 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea3ac2c8-063c-4125-94c4-cc13e6fb07f6"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:11 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:11 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:11 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:11 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c", "tag": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:11 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] Creating event network-changed:4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c on user Nov 28 06:45:11 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-8fd0b682-d417-49ee-93c7-b74e5feb66e9 req-b20a120e-28af-424f-a0b3-010370050c59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036976 Nov 28 06:45:11 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 134/402] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:11 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-95a6cd20-0068-48ab-8d6a-796958c190f8 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304558 Nov 28 06:45:11 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 131/403] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:45:11 2023] POST /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:11 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:11 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:11 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-ccef4c07-60c1-4143-881d-bba4aeee456b tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "POST /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333990 Nov 28 06:45:11 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 139/404] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:45:11 2023] POST /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:20 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:20 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] [instance: 636fad3b-617f-4a65-8cf7-ef67fd68304b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] HTTP exception thrown: Instance 636fad3b-617f-4a65-8cf7-ef67fd68304b could not be found. Nov 28 06:45:20 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Returning 404 to user: Instance 636fad3b-617f-4a65-8cf7-ef67fd68304b could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:45:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-7161491a-7379-48b4-b102-1652956b53be tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b" status: 404 len: 111 microversion: 2.1 time: 0.030717 Nov 28 06:45:20 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 135/405] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:20 2023] GET /compute/v2.1/servers/636fad3b-617f-4a65-8cf7-ef67fd68304b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:45:20 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-39b68ff7-446f-442f-a293-5a39d201bb2a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] Calling method '.version_select at 0x7f0b03a085e0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-39b68ff7-446f-442f-a293-5a39d201bb2a tempest-VolumesAdminNegativeTest-1747870246 tempest-VolumesAdminNegativeTest-1747870246-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078616029" status: 202 len: 0 microversion: 2.1 time: 0.026413 Nov 28 06:45:20 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 132/406] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 06:45:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078616029 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-46a3e892-c511-4d6e-af0b-e3df75ed8fbd tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-46a3e892-c511-4d6e-af0b-e3df75ed8fbd tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46a3e892-c511-4d6e-af0b-e3df75ed8fbd tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46a3e892-c511-4d6e-af0b-e3df75ed8fbd tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46a3e892-c511-4d6e-af0b-e3df75ed8fbd tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46a3e892-c511-4d6e-af0b-e3df75ed8fbd tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46a3e892-c511-4d6e-af0b-e3df75ed8fbd tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46a3e892-c511-4d6e-af0b-e3df75ed8fbd tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-46a3e892-c511-4d6e-af0b-e3df75ed8fbd tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065197 Nov 28 06:45:22 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 140/407] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:45:22 2023] GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:22 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:22 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:22 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:22 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-7dd0ce96-3a9a-4f47-b581-9f7301687032 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:22 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-7dd0ce96-3a9a-4f47-b581-9f7301687032 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7dd0ce96-3a9a-4f47-b581-9f7301687032 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7dd0ce96-3a9a-4f47-b581-9f7301687032 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7dd0ce96-3a9a-4f47-b581-9f7301687032 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7dd0ce96-3a9a-4f47-b581-9f7301687032 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7dd0ce96-3a9a-4f47-b581-9f7301687032 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7dd0ce96-3a9a-4f47-b581-9f7301687032 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:22 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lazy-loading 'services' on Instance uuid 9ec477b1-ae4b-4ec0-b396-353c82f38972 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:45:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-7e82962a-1066-4d40-a911-d708b1c6f786 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-volume_attachments/ea3ac2c8-063c-4125-94c4-cc13e6fb07f6" status: 202 len: 0 microversion: 2.1 time: 0.173149 Nov 28 06:45:22 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 136/408] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:45:22 2023] DELETE /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-volume_attachments/ea3ac2c8-063c-4125-94c4-cc13e6fb07f6 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:45:22 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-7dd0ce96-3a9a-4f47-b581-9f7301687032 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:22 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-7dd0ce96-3a9a-4f47-b581-9f7301687032 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1658 microversion: 2.1 time: 0.240242 Nov 28 06:45:22 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 133/409] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:22 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1658 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3a990fd7-78ab-4a78-af41-2ce70ad472aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-3a990fd7-78ab-4a78-af41-2ce70ad472aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3a990fd7-78ab-4a78-af41-2ce70ad472aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3a990fd7-78ab-4a78-af41-2ce70ad472aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3a990fd7-78ab-4a78-af41-2ce70ad472aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3a990fd7-78ab-4a78-af41-2ce70ad472aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3a990fd7-78ab-4a78-af41-2ce70ad472aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3a990fd7-78ab-4a78-af41-2ce70ad472aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:22 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-3a990fd7-78ab-4a78-af41-2ce70ad472aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-3a990fd7-78ab-4a78-af41-2ce70ad472aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1658 microversion: 2.1 time: 0.210997 Nov 28 06:45:22 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 141/410] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:22 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1658 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:45:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:24 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:24 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lazy-loading 'services' on Instance uuid 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:45:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-37566821-8a06-4ef1-b0df-efebe684cbe3 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/os-volume_attachments/6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef" status: 202 len: 0 microversion: 2.1 time: 0.193326 Nov 28 06:45:24 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 137/411] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:45:24 2023] DELETE /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/os-volume_attachments/6e6a870b-fd85-48a9-a41d-dbd5b21fc4ef => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:45:25 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6f2d31bb-9a3d-44af-9875-b8aa7ac5820a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:25 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6f2d31bb-9a3d-44af-9875-b8aa7ac5820a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f2d31bb-9a3d-44af-9875-b8aa7ac5820a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f2d31bb-9a3d-44af-9875-b8aa7ac5820a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f2d31bb-9a3d-44af-9875-b8aa7ac5820a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f2d31bb-9a3d-44af-9875-b8aa7ac5820a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f2d31bb-9a3d-44af-9875-b8aa7ac5820a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f2d31bb-9a3d-44af-9875-b8aa7ac5820a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:25 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6f2d31bb-9a3d-44af-9875-b8aa7ac5820a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042232 Nov 28 06:45:25 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 134/412] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:45:25 2023] GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:29 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4911020-1539-498a-bb5e-65870f6658e4"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:29 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-86f912bd-77a1-491b-bbb8-28684a69a929 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410701 Nov 28 06:45:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 142/413] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:45:29 2023] POST /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:45:34 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d7973373-80d1-44d5-833a-e13f12490f2f tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'create', calling method: .version_select at 0x7f0b03eeac20>, body: {"keypair": {"name": "tempest-keypair-612979215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhMTKkd1ufl9hog+OvjXVmfPk+XvYdF+hXylD4zqAQmN4Bbp6xlL5ppg9OKzY8cWzh/HuZnAqBA0EGu3zhCaPWM0WTLbwKdwYpiBQ4tQU/jWuH4ZUzP4d4/JUlWwHczSw=="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:34 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-d7973373-80d1-44d5-833a-e13f12490f2f tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting quotas for project 2a4f8529212249d68a54698cffcdc44b. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:45:34 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-d7973373-80d1-44d5-833a-e13f12490f2f tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting quotas for user 63fdd08d34954e97ae65ec1ce1c3d0f6 and project 2a4f8529212249d68a54698cffcdc44b. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:45:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d7973373-80d1-44d5-833a-e13f12490f2f tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164219 Nov 28 06:45:34 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 138/414] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:45:34 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1513439293", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "4674e5d4-7ef8-4582-a62f-45a48e5164b0"}], "security_groups": [{"name": "tempest-securitygroup--574339286"}], "key_name": "tempest-keypair-612979215", "user_data": "}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=12 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] validate_networks() for [('4674e5d4-7ef8-4582-a62f-45a48e5164b0', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:45:36 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-22567fc6-5ba0-42fb-925a-3f391c4d1d13 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:36 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-22567fc6-5ba0-42fb-925a-3f391c4d1d13 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-22567fc6-5ba0-42fb-925a-3f391c4d1d13 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-22567fc6-5ba0-42fb-925a-3f391c4d1d13 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-22567fc6-5ba0-42fb-925a-3f391c4d1d13 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-22567fc6-5ba0-42fb-925a-3f391c4d1d13 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-22567fc6-5ba0-42fb-925a-3f391c4d1d13 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-22567fc6-5ba0-42fb-925a-3f391c4d1d13 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:36 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-22567fc6-5ba0-42fb-925a-3f391c4d1d13 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cff054e141e43feb19997a67027f5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc4dd85b0ff45bd8e13a8266b18b843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:36 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-22567fc6-5ba0-42fb-925a-3f391c4d1d13 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10" status: 200 len: 1574 microversion: 2.1 time: 0.220574 Nov 28 06:45:36 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 143/415] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:36 2023] GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10 => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting quotas for project 2a4f8529212249d68a54698cffcdc44b. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting quotas for user 63fdd08d34954e97ae65ec1ce1c3d0f6 and project 2a4f8529212249d68a54698cffcdc44b. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:45:36 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:45:36 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9074553e-85fd-4563-a57c-cef6bae03202 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.583667 Nov 28 06:45:36 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 135/416] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:45:36 2023] POST /compute/v2.1/servers => generated 399 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:45:36 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:36 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-3228a537-b9b2-443c-bb7d-9415f25c5f96 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:36 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-3228a537-b9b2-443c-bb7d-9415f25c5f96 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:36 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-3228a537-b9b2-443c-bb7d-9415f25c5f96 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:36 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-3228a537-b9b2-443c-bb7d-9415f25c5f96 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1229 microversion: 2.1 time: 0.067726 Nov 28 06:45:36 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 139/417] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:36 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1229 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:45:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-32aa3ad8-c12e-4b15-ba64-8abe75054286 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:38 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-32aa3ad8-c12e-4b15-ba64-8abe75054286 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-32aa3ad8-c12e-4b15-ba64-8abe75054286 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-32aa3ad8-c12e-4b15-ba64-8abe75054286 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-32aa3ad8-c12e-4b15-ba64-8abe75054286 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-32aa3ad8-c12e-4b15-ba64-8abe75054286 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-32aa3ad8-c12e-4b15-ba64-8abe75054286 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-32aa3ad8-c12e-4b15-ba64-8abe75054286 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-32aa3ad8-c12e-4b15-ba64-8abe75054286 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070157 Nov 28 06:45:38 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 144/418] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:45:38 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:45:38 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f13fe5f4-5721-41cc-a131-33327fef177c tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '.version_select at 0x7f0b03a08c10>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f13fe5f4-5721-41cc-a131-33327fef177c tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/f40204eb-15d5-4f6d-a086-d9654a71267f" status: 204 len: 0 microversion: 2.1 time: 0.296999 Nov 28 06:45:38 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 136/419] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:38 2023] DELETE /compute/v2.1/images/f40204eb-15d5-4f6d-a086-d9654a71267f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:45:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:38 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:39 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:45:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5741ee3d-025f-4cea-90cc-a17ab4e02bd1 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620" status: 204 len: 0 microversion: 2.1 time: 0.127834 Nov 28 06:45:39 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 140/420] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:45:38 2023] DELETE /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:45:39 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-8958fa31-0ce6-4571-a412-4f372c64c3e9 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:39 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-8958fa31-0ce6-4571-a412-4f372c64c3e9 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:39 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8958fa31-0ce6-4571-a412-4f372c64c3e9 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:39 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8958fa31-0ce6-4571-a412-4f372c64c3e9 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:39 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8958fa31-0ce6-4571-a412-4f372c64c3e9 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:39 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8958fa31-0ce6-4571-a412-4f372c64c3e9 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:39 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8958fa31-0ce6-4571-a412-4f372c64c3e9 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:39 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8958fa31-0ce6-4571-a412-4f372c64c3e9 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:39 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] Creating event network-changed:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:45:39 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-bba09268-abd7-4133-b088-b989a44075e2 req-09b5f7a3-1a3a-44d1-b9bf-8a4b021ae529 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044656 Nov 28 06:45:39 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 137/421] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:39 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-8958fa31-0ce6-4571-a412-4f372c64c3e9 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f53e7a2f95545d196a5b2d36ef6d692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30dc21619f949b18be9362b217e7c1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:39 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-8958fa31-0ce6-4571-a412-4f372c64c3e9 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620" status: 200 len: 1673 microversion: 2.1 time: 0.291909 Nov 28 06:45:39 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 145/422] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:39 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620 => generated 1673 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:45:39 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-793ded4c-2afa-42e7-b65f-d04329a1960a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:39 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-793ded4c-2afa-42e7-b65f-d04329a1960a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-793ded4c-2afa-42e7-b65f-d04329a1960a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-793ded4c-2afa-42e7-b65f-d04329a1960a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-793ded4c-2afa-42e7-b65f-d04329a1960a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-793ded4c-2afa-42e7-b65f-d04329a1960a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-793ded4c-2afa-42e7-b65f-d04329a1960a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-793ded4c-2afa-42e7-b65f-d04329a1960a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:39 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:45:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-83442834-b35e-46bb-93c2-baa6b6c9b404 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd" status: 204 len: 0 microversion: 2.1 time: 0.119392 Nov 28 06:45:40 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 138/423] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:45:39 2023] DELETE /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:45:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f9cba6ac-c083-403d-a2ee-3d5a028da33d tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:40 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f9cba6ac-c083-403d-a2ee-3d5a028da33d tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f9cba6ac-c083-403d-a2ee-3d5a028da33d tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f9cba6ac-c083-403d-a2ee-3d5a028da33d tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f9cba6ac-c083-403d-a2ee-3d5a028da33d tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f9cba6ac-c083-403d-a2ee-3d5a028da33d tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f9cba6ac-c083-403d-a2ee-3d5a028da33d tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f9cba6ac-c083-403d-a2ee-3d5a028da33d tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:40 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-793ded4c-2afa-42e7-b65f-d04329a1960a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-793ded4c-2afa-42e7-b65f-d04329a1960a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1" status: 200 len: 1502 microversion: 2.1 time: 0.304764 Nov 28 06:45:40 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 141/424] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:39 2023] GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1 => generated 1502 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:45:40 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-f9cba6ac-c083-403d-a2ee-3d5a028da33d tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a520d2b45446098b6b97532a696bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4536fef53e47e4aac07b82ff452fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f9cba6ac-c083-403d-a2ee-3d5a028da33d tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd" status: 200 len: 1539 microversion: 2.1 time: 0.295617 Nov 28 06:45:40 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 146/425] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:40 2023] GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd => generated 1539 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:45:40 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-af0d428e-1c97-4048-b4d8-d851a40e1329 req-d222bf50-be04-4973-aed5-89fd3e0a4c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5b898b-f5f0-4504-94d0-53bf8d622620", "name": "network-vif-deleted", "tag": "d2a8e63d-4f39-4ef4-9d23-ad1f72acb858"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-af0d428e-1c97-4048-b4d8-d851a40e1329 req-d222bf50-be04-4973-aed5-89fd3e0a4c40 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-af0d428e-1c97-4048-b4d8-d851a40e1329 req-d222bf50-be04-4973-aed5-89fd3e0a4c40 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-af0d428e-1c97-4048-b4d8-d851a40e1329 req-d222bf50-be04-4973-aed5-89fd3e0a4c40 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-af0d428e-1c97-4048-b4d8-d851a40e1329 req-d222bf50-be04-4973-aed5-89fd3e0a4c40 service nova] Creating event network-vif-deleted:d2a8e63d-4f39-4ef4-9d23-ad1f72acb858 for instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 on user Nov 28 06:45:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-af0d428e-1c97-4048-b4d8-d851a40e1329 req-d222bf50-be04-4973-aed5-89fd3e0a4c40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028502 Nov 28 06:45:40 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 139/426] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:41 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25781b03-ef60-44cd-aab8-5f5b3350b8fd", "name": "network-vif-unplugged", "status": "completed", "tag": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae"}, {"server_uuid": "25781b03-ef60-44cd-aab8-5f5b3350b8fd", "name": "network-vif-plugged", "status": "completed", "tag": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Creating event network-vif-unplugged:6e4a143d-6a3f-45dc-955f-f6be6c3918ae for instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd on user Nov 28 06:45:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] Creating event network-vif-plugged:6e4a143d-6a3f-45dc-955f-f6be6c3918ae for instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd on user Nov 28 06:45:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-6007a961-ca39-4a1d-b684-fa4a93f174b0 req-c34bfced-07fa-411b-956c-18f65d9554c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038786 Nov 28 06:45:41 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 142/427] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:42 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-plugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}, {"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-plugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}, {"server_uuid": "25781b03-ef60-44cd-aab8-5f5b3350b8fd", "name": "network-vif-deleted", "tag": "6e4a143d-6a3f-45dc-955f-f6be6c3918ae"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Creating event network-vif-plugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:45:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Creating event network-vif-plugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:45:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] Creating event network-vif-deleted:6e4a143d-6a3f-45dc-955f-f6be6c3918ae for instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd on user Nov 28 06:45:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-137cca84-80f7-4d41-a644-cfcaff428d95 req-29a9cc9f-be39-4005-a908-7e05769431cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.036997 Nov 28 06:45:42 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 147/428] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:42 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:44 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9b722b68-1f79-454a-bce4-da2354e1a99b tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:44 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-9b722b68-1f79-454a-bce4-da2354e1a99b tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9b722b68-1f79-454a-bce4-da2354e1a99b tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9b722b68-1f79-454a-bce4-da2354e1a99b tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9b722b68-1f79-454a-bce4-da2354e1a99b tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9b722b68-1f79-454a-bce4-da2354e1a99b tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9b722b68-1f79-454a-bce4-da2354e1a99b tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9b722b68-1f79-454a-bce4-da2354e1a99b tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:44 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9b722b68-1f79-454a-bce4-da2354e1a99b tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042737 Nov 28 06:45:44 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 140/429] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:45:44 2023] GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6c82f2ff-e795-43ce-9e48-944830d6fd4e tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6c82f2ff-e795-43ce-9e48-944830d6fd4e tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c82f2ff-e795-43ce-9e48-944830d6fd4e tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c82f2ff-e795-43ce-9e48-944830d6fd4e tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c82f2ff-e795-43ce-9e48-944830d6fd4e tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c82f2ff-e795-43ce-9e48-944830d6fd4e tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c82f2ff-e795-43ce-9e48-944830d6fd4e tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6c82f2ff-e795-43ce-9e48-944830d6fd4e tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6c82f2ff-e795-43ce-9e48-944830d6fd4e tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045455 Nov 28 06:45:45 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 143/430] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:45:45 2023] GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:45:45 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:45 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:45 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:45:45 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-3bfa6c21-2a0f-4661-9e63-9faddb8a9e61 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972" status: 204 len: 0 microversion: 2.1 time: 0.118136 Nov 28 06:45:45 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 148/431] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:45:45 2023] DELETE /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:45:45 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-59cce668-0f1d-4a07-ad10-e630f1c5c141 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:45 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-59cce668-0f1d-4a07-ad10-e630f1c5c141 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-59cce668-0f1d-4a07-ad10-e630f1c5c141 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-59cce668-0f1d-4a07-ad10-e630f1c5c141 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-59cce668-0f1d-4a07-ad10-e630f1c5c141 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-59cce668-0f1d-4a07-ad10-e630f1c5c141 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-59cce668-0f1d-4a07-ad10-e630f1c5c141 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-59cce668-0f1d-4a07-ad10-e630f1c5c141 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:45 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-59cce668-0f1d-4a07-ad10-e630f1c5c141 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3ace56f1264298944b8b765f51417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11f8db963684cba9927a06dfb035bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-59cce668-0f1d-4a07-ad10-e630f1c5c141 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972" status: 200 len: 1671 microversion: 2.1 time: 0.303415 Nov 28 06:45:45 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 141/432] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:45 2023] GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972 => generated 1671 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec477b1-ae4b-4ec0-b396-353c82f38972", "name": "network-vif-unplugged", "status": "completed", "tag": "ea9497df-2959-489f-a6d7-4ce7a474741d"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] Creating event network-vif-unplugged:ea9497df-2959-489f-a6d7-4ce7a474741d for instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 on user Nov 28 06:45:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-5de9e126-4f96-4c8a-aec2-461d125686c8 req-14a35d6c-14c5-4b91-aa4b-b3afba851ee6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033022 Nov 28 06:45:45 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 144/433] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:47 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec477b1-ae4b-4ec0-b396-353c82f38972", "name": "network-vif-plugged", "status": "completed", "tag": "ea9497df-2959-489f-a6d7-4ce7a474741d"}, {"server_uuid": "9ec477b1-ae4b-4ec0-b396-353c82f38972", "name": "network-vif-deleted", "tag": "ea9497df-2959-489f-a6d7-4ce7a474741d"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] Creating event network-vif-plugged:ea9497df-2959-489f-a6d7-4ce7a474741d for instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 on user Nov 28 06:45:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] Creating event network-vif-deleted:ea9497df-2959-489f-a6d7-4ce7a474741d for instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 on user Nov 28 06:45:48 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-96da6bf2-ed2b-452a-b2c7-723d158ca032 req-746f1476-c81f-447f-ac6a-0b97c70caf92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031000 Nov 28 06:45:48 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 149/434] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:45:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-460b0831-c6bd-4c00-9b5e-8dd71a146993 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-460b0831-c6bd-4c00-9b5e-8dd71a146993 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-460b0831-c6bd-4c00-9b5e-8dd71a146993 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-460b0831-c6bd-4c00-9b5e-8dd71a146993 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-460b0831-c6bd-4c00-9b5e-8dd71a146993 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-460b0831-c6bd-4c00-9b5e-8dd71a146993 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-460b0831-c6bd-4c00-9b5e-8dd71a146993 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-460b0831-c6bd-4c00-9b5e-8dd71a146993 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:48 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-460b0831-c6bd-4c00-9b5e-8dd71a146993 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-460b0831-c6bd-4c00-9b5e-8dd71a146993 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" status: 200 len: 1543 microversion: 2.1 time: 0.200760 Nov 28 06:45:48 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 142/435] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:48 2023] GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa => generated 1543 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:50 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:50 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0cd39bc3-57a6-4fba-ad91-59640ed5b632 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5" status: 200 len: 1770 microversion: 2.87 time: 0.269422 Nov 28 06:45:50 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 145/436] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:45:50 2023] GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5 => generated 1770 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:45:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-951c2d38-1d2c-4307-8dba-fafd3f3dc356 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1172971060", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f62a76e5-f00c-416b-84d0-db9b754396ab", "destination_type": "local"}, {"source_type": "volume", "uuid": "1895d4f9-531a-44e7-a9fb-26a477aacbcc", "destination_type": "invalid"}], "networks": [{"uuid": "25e958b1-76c6-4b10-aa2d-7792c3a7c44a"}]}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:45:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-951c2d38-1d2c-4307-8dba-fafd3f3dc356 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:45:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-951c2d38-1d2c-4307-8dba-fafd3f3dc356 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.008601 Nov 28 06:45:52 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 150/437] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:45:52 2023] POST /compute/v2.1/servers => generated 155 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:45:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6f6b31e8-3735-4a65-a8f2-e5975168f42c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:45:52 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6f6b31e8-3735-4a65-a8f2-e5975168f42c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:45:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f6b31e8-3735-4a65-a8f2-e5975168f42c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f6b31e8-3735-4a65-a8f2-e5975168f42c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f6b31e8-3735-4a65-a8f2-e5975168f42c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f6b31e8-3735-4a65-a8f2-e5975168f42c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:45:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f6b31e8-3735-4a65-a8f2-e5975168f42c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:45:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6f6b31e8-3735-4a65-a8f2-e5975168f42c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:45:53 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-6f6b31e8-3735-4a65-a8f2-e5975168f42c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:45:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6f6b31e8-3735-4a65-a8f2-e5975168f42c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" status: 200 len: 1491 microversion: 2.1 time: 0.187848 Nov 28 06:45:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 143/438] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:45:52 2023] GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e => generated 1491 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:46:00 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1043548b-0314-4335-8258-596bd4bf9278 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:00 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-1043548b-0314-4335-8258-596bd4bf9278 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1043548b-0314-4335-8258-596bd4bf9278 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1043548b-0314-4335-8258-596bd4bf9278 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1043548b-0314-4335-8258-596bd4bf9278 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1043548b-0314-4335-8258-596bd4bf9278 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1043548b-0314-4335-8258-596bd4bf9278 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1043548b-0314-4335-8258-596bd4bf9278 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:00 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-1043548b-0314-4335-8258-596bd4bf9278 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1043548b-0314-4335-8258-596bd4bf9278 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1704 microversion: 2.1 time: 0.196701 Nov 28 06:46:00 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 146/439] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:00 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1704 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e3785e6f-8c45-46a9-9884-06179563807a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e3785e6f-8c45-46a9-9884-06179563807a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e3785e6f-8c45-46a9-9884-06179563807a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e3785e6f-8c45-46a9-9884-06179563807a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e3785e6f-8c45-46a9-9884-06179563807a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e3785e6f-8c45-46a9-9884-06179563807a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e3785e6f-8c45-46a9-9884-06179563807a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e3785e6f-8c45-46a9-9884-06179563807a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:00 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-e3785e6f-8c45-46a9-9884-06179563807a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e3785e6f-8c45-46a9-9884-06179563807a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1704 microversion: 2.1 time: 0.245418 Nov 28 06:46:00 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 151/440] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:00 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1704 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:46:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5a46efd1-5e62-4218-bbc2-811ed74b173e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:15 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-5a46efd1-5e62-4218-bbc2-811ed74b173e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:15 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:15 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5a46efd1-5e62-4218-bbc2-811ed74b173e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5a46efd1-5e62-4218-bbc2-811ed74b173e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5a46efd1-5e62-4218-bbc2-811ed74b173e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5a46efd1-5e62-4218-bbc2-811ed74b173e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5a46efd1-5e62-4218-bbc2-811ed74b173e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5a46efd1-5e62-4218-bbc2-811ed74b173e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5a46efd1-5e62-4218-bbc2-811ed74b173e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051053 Nov 28 06:46:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 144/441] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:46:15 2023] GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=9 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c", "tag": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:15 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:15 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] Creating event network-changed:4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c on user Nov 28 06:46:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-cc2a0516-64d0-469d-8835-b8cc6c43f3e3 req-a16dddf6-55b6-4199-adb6-b68223eb8e85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035414 Nov 28 06:46:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 152/442] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:15 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:46:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5d5405cf-5d46-4f48-8450-6fc4e8875d9e tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" status: 204 len: 0 microversion: 2.1 time: 0.139194 Nov 28 06:46:16 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 147/443] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:46:15 2023] DELETE /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:46:16 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8f0eb0b9-ab93-4f2b-9c5d-2b4caca31004 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:16 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8f0eb0b9-ab93-4f2b-9c5d-2b4caca31004 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f0eb0b9-ab93-4f2b-9c5d-2b4caca31004 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f0eb0b9-ab93-4f2b-9c5d-2b4caca31004 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f0eb0b9-ab93-4f2b-9c5d-2b4caca31004 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f0eb0b9-ab93-4f2b-9c5d-2b4caca31004 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f0eb0b9-ab93-4f2b-9c5d-2b4caca31004 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f0eb0b9-ab93-4f2b-9c5d-2b4caca31004 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:16 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c", "name": "network-vif-unplugged", "status": "completed", "tag": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] Creating event network-vif-unplugged:4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c on user Nov 28 06:46:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-f50cbdd2-c492-48ae-866a-fb0abf98d3f6 req-4be4dc2d-d916-4186-a5c1-a4a0594640e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028873 Nov 28 06:46:16 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 153/444] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:17 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-8f0eb0b9-ab93-4f2b-9c5d-2b4caca31004 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73373ee05e1b4e09b5c0870750a77262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cff8da56da484d9dfee1b8118474b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8f0eb0b9-ab93-4f2b-9c5d-2b4caca31004 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" status: 200 len: 1658 microversion: 2.1 time: 0.398407 Nov 28 06:46:17 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 145/445] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:16 2023] GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c => generated 1658 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:46:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-92224654-e862-4c7c-a071-856ed803a095 req-456704ee-0902-4e97-834f-bb0ff9dee4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c", "name": "network-vif-deleted", "tag": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-92224654-e862-4c7c-a071-856ed803a095 req-456704ee-0902-4e97-834f-bb0ff9dee4f8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-92224654-e862-4c7c-a071-856ed803a095 req-456704ee-0902-4e97-834f-bb0ff9dee4f8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-92224654-e862-4c7c-a071-856ed803a095 req-456704ee-0902-4e97-834f-bb0ff9dee4f8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-92224654-e862-4c7c-a071-856ed803a095 req-456704ee-0902-4e97-834f-bb0ff9dee4f8 service nova] Creating event network-vif-deleted:4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c on user Nov 28 06:46:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-92224654-e862-4c7c-a071-856ed803a095 req-456704ee-0902-4e97-834f-bb0ff9dee4f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031418 Nov 28 06:46:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 148/446] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:18 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77393c2a-5fb1-48ec-88bd-a13fc6f39f3c", "name": "network-vif-plugged", "status": "completed", "tag": "4c2e30a2-39fb-43e0-bcea-6a752bc5a76b"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] Creating event network-vif-plugged:4c2e30a2-39fb-43e0-bcea-6a752bc5a76b for instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c on user Nov 28 06:46:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-704bee9e-96fe-433d-8f68-e95d197130fa req-c19a60f1-f723-4bc0-9608-b13b4ebf4dc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029261 Nov 28 06:46:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 154/447] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:23 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d77319ea-923f-44cd-a731-3504f09f3262 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Action: 'create', calling method: .version_select at 0x7f0b039120e0>, body: {"keypair": {"name": "tempest-keypair-940347240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmqLTpUt/GU9yvMrg2oFiSESQofNpPrZsXiEL9f15OtKAvJptGOgxftpECrxCxlIAlJRm7/xjBAW+Trfju5DhW8U9i2kJtsZpVyX3XUcmJWEukNZ0r+FHSn0qo7ujdISQ=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:23 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-d77319ea-923f-44cd-a731-3504f09f3262 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:46:23 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-d77319ea-923f-44cd-a731-3504f09f3262 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for user b7b9a26798e14399ac1a70568432485e and project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:46:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d77319ea-923f-44cd-a731-3504f09f3262 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045944 Nov 28 06:46:23 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 146/448] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:46:23 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-865386610", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "7ded7b1e-cfba-4af0-9866-0a4d18198920"}], "security_groups": [{"name": "tempest-securitygroup--633504615"}], "key_name": "tempest-keypair-940347240", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:24 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] validate_networks() for [('7ded7b1e-cfba-4af0-9866-0a4d18198920', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for user b7b9a26798e14399ac1a70568432485e and project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:46:25 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:46:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-4687b765-36f6-44be-8769-39d93849d956 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.676553 Nov 28 06:46:25 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 149/449] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:46:24 2023] POST /compute/v2.1/servers => generated 403 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:46:25 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-0c9ad6f2-81db-4df0-bb1f-af1c19e10401 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:25 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-0c9ad6f2-81db-4df0-bb1f-af1c19e10401 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:25 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-0c9ad6f2-81db-4df0-bb1f-af1c19e10401 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:25 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-0c9ad6f2-81db-4df0-bb1f-af1c19e10401 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa" status: 200 len: 1232 microversion: 2.1 time: 0.063267 Nov 28 06:46:25 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 155/450] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:25 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa => generated 1232 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:46:26 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=12 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:26 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8a3de2f6-e798-4251-85f6-77aaf915c5a5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:26 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8a3de2f6-e798-4251-85f6-77aaf915c5a5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a3de2f6-e798-4251-85f6-77aaf915c5a5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a3de2f6-e798-4251-85f6-77aaf915c5a5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a3de2f6-e798-4251-85f6-77aaf915c5a5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a3de2f6-e798-4251-85f6-77aaf915c5a5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a3de2f6-e798-4251-85f6-77aaf915c5a5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8a3de2f6-e798-4251-85f6-77aaf915c5a5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:27 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-8a3de2f6-e798-4251-85f6-77aaf915c5a5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8a3de2f6-e798-4251-85f6-77aaf915c5a5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1534 microversion: 2.1 time: 0.266224 Nov 28 06:46:27 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 147/451] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:26 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1534 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:46:27 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] Creating event network-changed:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:46:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-ef9824a2-7427-4015-84b8-8fec47d5b68c req-6b5ec91c-5eee-4aad-b07f-ddb2d5c8970a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033394 Nov 28 06:46:27 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 150/452] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:29 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:29 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] [instance: 0e5b898b-f5f0-4504-94d0-53bf8d622620] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:29 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:29 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] HTTP exception thrown: Instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 could not be found. Nov 28 06:46:29 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Returning 404 to user: Instance 0e5b898b-f5f0-4504-94d0-53bf8d622620 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:29 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-bc1c9aec-8407-4aea-9ba9-edbf4f826539 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620" status: 404 len: 111 microversion: 2.1 time: 0.034995 Nov 28 06:46:29 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 156/453] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:29 2023] GET /compute/v2.1/servers/0e5b898b-f5f0-4504-94d0-53bf8d622620 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-3e441e34-9d98-4efc-b1d4-ebd6369bf206 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] Calling method '.version_select at 0x7f0b03a08c10>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-3e441e34-9d98-4efc-b1d4-ebd6369bf206 tempest-ServerStableDeviceRescueTest-1091796361 tempest-ServerStableDeviceRescueTest-1091796361-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-142163135" status: 202 len: 0 microversion: 2.1 time: 0.028867 Nov 28 06:46:29 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 148/454] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 06:46:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-142163135 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:46:29 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "name": "network-vif-plugged", "status": "completed", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] Creating event network-vif-plugged:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:46:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-65a8ce70-d8cc-4794-89e7-29f879f92a62 req-e7177cfe-d841-4a6b-9690-5d9596b4370b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038664 Nov 28 06:46:29 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 151/455] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:46:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:30 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] HTTP exception thrown: Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd could not be found. Nov 28 06:46:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Returning 404 to user: Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-993e1887-5678-4d72-a06d-f2fd91f1db77 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd" status: 404 len: 111 microversion: 2.1 time: 0.042946 Nov 28 06:46:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 157/456] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:30 2023] GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:30 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:30 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:30 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] HTTP exception thrown: Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd could not be found. Nov 28 06:46:30 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Returning 404 to user: Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:30 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6e96bcab-cb7b-427b-b595-1e47b9b2d218 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029649 Nov 28 06:46:30 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 149/457] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:46:30 2023] GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:31 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "name": "network-vif-plugged", "status": "completed", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] Creating event network-vif-plugged:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:46:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-6b1f2176-ef7a-4790-8627-c0950c683bad req-9c6c0273-5fa0-410f-9438-b008f343af80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030179 Nov 28 06:46:31 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 152/458] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] HTTP exception thrown: Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd could not be found. Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Returning 404 to user: Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-6b49a26e-0f24-40c5-8ad2-999e5ad3a8b0 tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd" status: 404 len: 111 microversion: 2.1 time: 0.030044 Nov 28 06:46:35 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 158/459] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:46:35 2023] DELETE /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:35 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:35 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] [instance: 25781b03-ef60-44cd-aab8-5f5b3350b8fd] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:35 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:35 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] HTTP exception thrown: Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd could not be found. Nov 28 06:46:35 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] Returning 404 to user: Instance 25781b03-ef60-44cd-aab8-5f5b3350b8fd could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:35 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a5a68a23-f735-4114-8618-da464797ba4a tempest-DeleteServersTestJSON-1238418010 tempest-DeleteServersTestJSON-1238418010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd" status: 404 len: 111 microversion: 2.1 time: 0.032870 Nov 28 06:46:35 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 150/460] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:35 2023] GET /compute/v2.1/servers/25781b03-ef60-44cd-aab8-5f5b3350b8fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:35 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] HTTP exception thrown: Instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 could not be found. Nov 28 06:46:35 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Returning 404 to user: Instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:35 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-dbaa1cca-3494-4057-bcc1-4724ee365e6a tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972" status: 404 len: 111 microversion: 2.1 time: 0.040415 Nov 28 06:46:35 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 153/461] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:35 2023] GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c6df5772-dae4-430d-8bb4-a4985b564a46 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '.version_select at 0x7f0b03cd9cf0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:35 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-c6df5772-dae4-430d-8bb4-a4985b564a46 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058119261" status: 202 len: 0 microversion: 2.1 time: 0.025218 Nov 28 06:46:35 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 159/462] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 06:46:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058119261 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:46:36 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-bf93aa6e-1878-4c20-8583-e472ed44b269 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:36 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-bf93aa6e-1878-4c20-8583-e472ed44b269 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf93aa6e-1878-4c20-8583-e472ed44b269 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf93aa6e-1878-4c20-8583-e472ed44b269 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf93aa6e-1878-4c20-8583-e472ed44b269 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf93aa6e-1878-4c20-8583-e472ed44b269 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf93aa6e-1878-4c20-8583-e472ed44b269 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bf93aa6e-1878-4c20-8583-e472ed44b269 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:36 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-bf93aa6e-1878-4c20-8583-e472ed44b269 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.271378 Nov 28 06:46:36 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 151/463] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:46:36 2023] GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-interface => generated 282 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3a1360-d402-4962-9b05-ca0288480b10", "tag": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] Creating event network-changed:a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance cb3a1360-d402-4962-9b05-ca0288480b10 on user Nov 28 06:46:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-521dcd17-d325-4623-94a2-789e803a954b req-c42063cf-7479-4183-a4fa-4e717e0d7505 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038414 Nov 28 06:46:38 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 154/464] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-0b8dc085-2b55-4c1a-8a2a-f3ed230c5b5d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:38 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-0b8dc085-2b55-4c1a-8a2a-f3ed230c5b5d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0b8dc085-2b55-4c1a-8a2a-f3ed230c5b5d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0b8dc085-2b55-4c1a-8a2a-f3ed230c5b5d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0b8dc085-2b55-4c1a-8a2a-f3ed230c5b5d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0b8dc085-2b55-4c1a-8a2a-f3ed230c5b5d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0b8dc085-2b55-4c1a-8a2a-f3ed230c5b5d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0b8dc085-2b55-4c1a-8a2a-f3ed230c5b5d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:38 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-0b8dc085-2b55-4c1a-8a2a-f3ed230c5b5d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cff054e141e43feb19997a67027f5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc4dd85b0ff45bd8e13a8266b18b843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-0b8dc085-2b55-4c1a-8a2a-f3ed230c5b5d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10" status: 200 len: 1574 microversion: 2.1 time: 0.364712 Nov 28 06:46:38 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 160/465] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:38 2023] GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10 => generated 1574 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:46:38 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:38 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5cff054e141e43feb19997a67027f5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc4dd85b0ff45bd8e13a8266b18b843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:38 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Searching by: {'deleted': False, 'project_id': '8bc4dd85b0ff45bd8e13a8266b18b843'} {{(pid=64871) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 06:46:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:38 user devstack@n-api.service[64871]: DEBUG nova.compute.multi_cell_list [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 06:46:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-13749d7f-fdae-4830-b491-320a67a776d1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 357 microversion: 2.1 time: 0.259343 Nov 28 06:46:38 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 152/466] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 06:46:38 2023] GET /compute/v2.1/servers => generated 357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:39 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-77d3f063-cfdd-4997-9c5d-1cfccbbbcb5d tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Action: 'create', calling method: .version_select at 0x7f0b03a99240>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-352500032"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-77d3f063-cfdd-4997-9c5d-1cfccbbbcb5d tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.594124 Nov 28 06:46:39 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 155/467] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Nov 28 06:46:39 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 596 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 28 06:46:39 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-26c4a8c6-31b4-4711-bb79-50fcb4aba275 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03bee170>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:39 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-26c4a8c6-31b4-4711-bb79-50fcb4aba275 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 200 len: 344 microversion: 2.1 time: 0.071715 Nov 28 06:46:39 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 161/468] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:46:39 2023] GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:40 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:40 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] HTTP exception thrown: Instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 could not be found. Nov 28 06:46:40 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Returning 404 to user: Instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-84bfc2af-0f60-4b71-b551-8131d6447e20 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972" status: 404 len: 111 microversion: 2.1 time: 0.043379 Nov 28 06:46:40 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 153/469] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:46:40 2023] DELETE /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:40 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:40 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] [instance: 9ec477b1-ae4b-4ec0-b396-353c82f38972] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] HTTP exception thrown: Instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 could not be found. Nov 28 06:46:40 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] Returning 404 to user: Instance 9ec477b1-ae4b-4ec0-b396-353c82f38972 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-008389a2-f69e-46d7-bc41-c3a9447352e2 tempest-AttachSCSIVolumeTestJSON-952007140 tempest-AttachSCSIVolumeTestJSON-952007140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972" status: 404 len: 111 microversion: 2.1 time: 0.028929 Nov 28 06:46:40 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 156/470] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:40 2023] GET /compute/v2.1/servers/9ec477b1-ae4b-4ec0-b396-353c82f38972 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 06:46:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b4bac500-e78d-4c28-96ab-7880212d7614 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b038cf010>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b4bac500-e78d-4c28-96ab-7880212d7614 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 200 len: 344 microversion: 2.1 time: 0.087738 Nov 28 06:46:40 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 162/471] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:46:40 2023] GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:41 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24cf45f7-d5e5-4e17-82bf-581233d29ba3"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:41 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:41 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ec9be3a6-5658-43a3-acd2-0c909778d735 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03be1ea0>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:42 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-ec9be3a6-5658-43a3-acd2-0c909778d735 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 200 len: 345 microversion: 2.1 time: 0.081136 Nov 28 06:46:42 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 157/472] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:46:41 2023] GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:42 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d2dcdd39-e121-4444-8516-8d90daec3c70 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Action: 'create', calling method: .version_select at 0x7f0b03bef640>, body: {"snapshot": {"volume_id": "a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-197913916"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:42 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-2c314904-bf76-4ea5-9ec2-4175b7f7ebfb tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482267 Nov 28 06:46:42 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 154/473] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:46:41 2023] POST /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d2dcdd39-e121-4444-8516-8d90daec3c70 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.219204 Nov 28 06:46:42 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 163/474] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Nov 28 06:46:42 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:42 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-a16aee67-40b6-418e-8480-e9274f697ffe tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03adea70>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:42 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-a16aee67-40b6-418e-8480-e9274f697ffe tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410" status: 200 len: 286 microversion: 2.1 time: 0.058046 Nov 28 06:46:42 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 158/475] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 06:46:42 2023] GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:42 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-58e4c1ea-cea8-423f-b1bd-3230c901b04e tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03910940>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:42 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-58e4c1ea-cea8-423f-b1bd-3230c901b04e tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.074511 Nov 28 06:46:42 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 155/476] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 28 06:46:42 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:42 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-ae8e2e11-bd27-48bb-9fd7-3b9bffcabb2b tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03d4e9e0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-ae8e2e11-bd27-48bb-9fd7-3b9bffcabb2b tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410" status: 200 len: 286 microversion: 2.1 time: 0.039801 Nov 28 06:46:42 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 164/477] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 06:46:42 2023] GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:42 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-015b98fd-3668-492b-9509-ea3e13a5bb8a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'create', calling method: .version_select at 0x7f0b03adfa30>, body: {"keypair": {"name": "tempest-keypair-2000231521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCT7W9jPmL2DNpNb9OOlPJ8LYFXcuPwkRJcaH1BxAIpcqXX2ZN2vfpsNvMAsDzCxKGMuLnCMHJxT/KP2cJ3GsZiR1qHhSqRW1ZO6lSQzJztb7FbdXbjL1GzTWYUBOtmlQ=="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:42 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-015b98fd-3668-492b-9509-ea3e13a5bb8a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting quotas for project 8f90603ba77644568ec6f6fd37689a08. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:46:42 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-015b98fd-3668-492b-9509-ea3e13a5bb8a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting quotas for user 109001cce8ec4aa0b87f271b415cd5e6 and project 8f90603ba77644568ec6f6fd37689a08. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:46:42 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-015b98fd-3668-492b-9509-ea3e13a5bb8a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081267 Nov 28 06:46:42 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 159/478] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:46:42 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-3d3dca3d-08e0-4127-91f0-adfeff192418 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b039135b0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-3d3dca3d-08e0-4127-91f0-adfeff192418 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410" status: 200 len: 286 microversion: 2.1 time: 0.074672 Nov 28 06:46:43 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 156/479] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 06:46:43 2023] GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:44 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b34440a9-f805-416e-8a7b-fc7d76eecff2 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03d4fc70>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:44 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b34440a9-f805-416e-8a7b-fc7d76eecff2 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410" status: 200 len: 286 microversion: 2.1 time: 0.038757 Nov 28 06:46:44 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 165/480] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 06:46:44 2023] GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:46:44 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1621425112", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "74dfaac2-1093-4fe2-8322-f49e14500d58"}], "security_groups": [{"name": "tempest-securitygroup--1899470286"}], "key_name": "tempest-keypair-2000231521", "user_data": "}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] validate_networks() for [('74dfaac2-1093-4fe2-8322-f49e14500d58', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:46:45 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a147cd76-e796-4f64-a42c-4656faaae91a tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03912dd0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a147cd76-e796-4f64-a42c-4656faaae91a tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410" status: 200 len: 287 microversion: 2.1 time: 0.033280 Nov 28 06:46:45 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 157/481] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 06:46:45 2023] GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:45 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d2511bab-c071-48db-bd0c-76133191c04f tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03902cb0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:45 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d2511bab-c071-48db-bd0c-76133191c04f tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410" status: 202 len: 0 microversion: 2.1 time: 0.076566 Nov 28 06:46:45 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 166/482] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Nov 28 06:46:45 2023] DELETE /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:46:45 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ec857ed5-99b7-4a83-a69e-a6d82839271f tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b039128c0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ec857ed5-99b7-4a83-a69e-a6d82839271f tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410" status: 200 len: 286 microversion: 2.1 time: 0.037402 Nov 28 06:46:45 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 158/483] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 06:46:45 2023] GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:46 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting quotas for project 8f90603ba77644568ec6f6fd37689a08. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:46:46 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Getting quotas for user 109001cce8ec4aa0b87f271b415cd5e6 and project 8f90603ba77644568ec6f6fd37689a08. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:46:46 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:46:46 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:46:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-cc413ec7-065c-42a7-8686-a03ee9a55760 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.233949 Nov 28 06:46:46 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 160/484] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:46:44 2023] POST /compute/v2.1/servers => generated 407 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:46:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-392e604b-7a17-45aa-8e5c-0cbbae4407e7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:46 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-392e604b-7a17-45aa-8e5c-0cbbae4407e7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:46 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-392e604b-7a17-45aa-8e5c-0cbbae4407e7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-392e604b-7a17-45aa-8e5c-0cbbae4407e7 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a" status: 200 len: 1238 microversion: 2.1 time: 0.110117 Nov 28 06:46:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 167/485] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:46:46 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a => generated 1238 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:46:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e5c2a1db-e5df-4683-b394-37282bbce806 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03912c20>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e5c2a1db-e5df-4683-b394-37282bbce806 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410" status: 200 len: 286 microversion: 2.1 time: 0.034560 Nov 28 06:46:46 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 159/486] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 06:46:46 2023] GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:47 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-bcc350ba-e4e7-4905-967a-a7a95ab38c04 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03ade4d0>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:47 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-bcc350ba-e4e7-4905-967a-a7a95ab38c04 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410" status: 200 len: 286 microversion: 2.1 time: 0.066775 Nov 28 06:46:47 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 161/487] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 06:46:47 2023] GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:48 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-552cf9d4-22f4-42c7-9aab-042370262938 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:48 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-552cf9d4-22f4-42c7-9aab-042370262938 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:48 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=12 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-552cf9d4-22f4-42c7-9aab-042370262938 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-552cf9d4-22f4-42c7-9aab-042370262938 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-552cf9d4-22f4-42c7-9aab-042370262938 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-552cf9d4-22f4-42c7-9aab-042370262938 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-552cf9d4-22f4-42c7-9aab-042370262938 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-552cf9d4-22f4-42c7-9aab-042370262938 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:48 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:48 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-72b4a549-f10d-472a-8d70-536818850910 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03910a60>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-72b4a549-f10d-472a-8d70-536818850910 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] HTTP exception thrown: Snapshot fe9754c4-94a8-46b3-ae0f-2d0d15940410 could not be found. Nov 28 06:46:48 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-72b4a549-f10d-472a-8d70-536818850910 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Returning 404 to user: Snapshot fe9754c4-94a8-46b3-ae0f-2d0d15940410 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-72b4a549-f10d-472a-8d70-536818850910 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410" status: 404 len: 111 microversion: 2.1 time: 0.036436 Nov 28 06:46:48 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 160/488] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 06:46:48 2023] GET /compute/v2.1/os-snapshots/fe9754c4-94a8-46b3-ae0f-2d0d15940410 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-2a709921-8bf3-4e27-9250-9a248cf2a8e5 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03a9aa70>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-2a709921-8bf3-4e27-9250-9a248cf2a8e5 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 202 len: 0 microversion: 2.1 time: 0.070459 Nov 28 06:46:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 162/489] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:46:49 2023] DELETE /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:46:49 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6dbf9936-3fb7-475b-bb44-58c9c70fe44f tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b039120e0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-552cf9d4-22f4-42c7-9aab-042370262938 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.233003 Nov 28 06:46:49 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 168/490] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:46:48 2023] GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-interface => generated 282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:49 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6dbf9936-3fb7-475b-bb44-58c9c70fe44f tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 200 len: 344 microversion: 2.1 time: 0.066708 Nov 28 06:46:49 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 161/491] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:46:49 2023] GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] Creating event network-changed:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:46:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-81a918f8-2074-4b91-8cb9-514f16ca975d req-d777f29a-dd65-4740-8efb-8cf4962ef04e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052860 Nov 28 06:46:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 163/492] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:50 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b97003d6-01e4-4c7c-bae6-b1b2749ed5cd tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03902cb0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa", "tag": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] Creating event network-changed:b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa on user Nov 28 06:46:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-ee7b6603-7f84-4c94-a8a0-700c75caaf0a req-85130a80-6ce8-4858-8b72-d14fe93754cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031528 Nov 28 06:46:50 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 162/493] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b97003d6-01e4-4c7c-bae6-b1b2749ed5cd tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 200 len: 344 microversion: 2.1 time: 0.158416 Nov 28 06:46:50 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 169/494] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:46:50 2023] GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 344 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:50 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9d25f304-a49c-4b03-a78d-28b9a2c7f906 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:50 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9d25f304-a49c-4b03-a78d-28b9a2c7f906 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d25f304-a49c-4b03-a78d-28b9a2c7f906 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d25f304-a49c-4b03-a78d-28b9a2c7f906 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d25f304-a49c-4b03-a78d-28b9a2c7f906 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d25f304-a49c-4b03-a78d-28b9a2c7f906 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d25f304-a49c-4b03-a78d-28b9a2c7f906 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d25f304-a49c-4b03-a78d-28b9a2c7f906 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:50 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9d25f304-a49c-4b03-a78d-28b9a2c7f906 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/ips" status: 200 len: 108 microversion: 2.1 time: 0.038346 Nov 28 06:46:50 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 164/495] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:46:50 2023] GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/ips => generated 108 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1112120856", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "7bc73412-fe34-4d8c-85c8-4cc726512d5e"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:50 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] validate_networks() for [('7bc73412-fe34-4d8c-85c8-4cc726512d5e', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:46:51 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-eda353f4-9737-4ec8-82fa-c6d3b51154ab tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03d4f0a0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:51 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-eda353f4-9737-4ec8-82fa-c6d3b51154ab tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 200 len: 344 microversion: 2.1 time: 0.055857 Nov 28 06:46:51 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 170/496] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:46:51 2023] GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting quotas for project a07e9312175c4e73aa29a51865d61ebd. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting quotas for user c13b793a926942e88fc3416cf3fa005e and project a07e9312175c4e73aa29a51865d61ebd. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:46:51 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:46:51 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a9461f6a-7997-4f08-9fd7-0881081ebcbc tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.756159 Nov 28 06:46:51 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 163/497] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 06:46:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 06:46:51 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9b46198d-becb-4d04-9d76-7a73d254b3fd tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:51 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9b46198d-becb-4d04-9d76-7a73d254b3fd tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:51 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-9b46198d-becb-4d04-9d76-7a73d254b3fd tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:51 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-9b46198d-becb-4d04-9d76-7a73d254b3fd tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:51 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-9b46198d-becb-4d04-9d76-7a73d254b3fd tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:46:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9b46198d-becb-4d04-9d76-7a73d254b3fd tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8" status: 200 len: 1395 microversion: 2.87 time: 0.103101 Nov 28 06:46:51 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 165/498] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:46:51 2023] GET /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8 => generated 1395 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:46:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d622025a-fb83-44e4-8186-333aa74e0530 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03902cb0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d622025a-fb83-44e4-8186-333aa74e0530 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 200 len: 344 microversion: 2.1 time: 0.076877 Nov 28 06:46:52 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 171/499] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:46:52 2023] GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fb72480-0480-4bd1-b99b-437dbcddc280"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:52 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-08eb8427-e37f-49c5-864e-9c71a885f63e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500631 Nov 28 06:46:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 164/500] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:46:52 2023] POST /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:53 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c8e437fa-d37c-481b-b59c-69cd599fcf22 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03e2a440>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:53 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-c8e437fa-d37c-481b-b59c-69cd599fcf22 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] HTTP exception thrown: Volume a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa could not be found. Nov 28 06:46:53 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c8e437fa-d37c-481b-b59c-69cd599fcf22 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Returning 404 to user: Volume a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:53 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c8e437fa-d37c-481b-b59c-69cd599fcf22 tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 404 len: 109 microversion: 2.1 time: 0.048584 Nov 28 06:46:53 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 166/501] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:46:53 2023] GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:53 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a809a154-f484-4a54-bec6-13a5a73927da tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03bee170>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-a809a154-f484-4a54-bec6-13a5a73927da tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] HTTP exception thrown: Volume a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa could not be found. Nov 28 06:46:53 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a809a154-f484-4a54-bec6-13a5a73927da tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Returning 404 to user: Volume a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a809a154-f484-4a54-bec6-13a5a73927da tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 404 len: 109 microversion: 2.1 time: 0.048220 Nov 28 06:46:53 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 172/502] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:46:53 2023] DELETE /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 06:46:53 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-234ad0a1-80ef-47a0-9b5a-58fc01f9b60e tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Calling method '.version_select at 0x7f0b03910160>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-234ad0a1-80ef-47a0-9b5a-58fc01f9b60e tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] HTTP exception thrown: Volume a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa could not be found. Nov 28 06:46:53 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-234ad0a1-80ef-47a0-9b5a-58fc01f9b60e tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] Returning 404 to user: Volume a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-234ad0a1-80ef-47a0-9b5a-58fc01f9b60e tempest-VolumesSnapshotsTestJSON-1066428061 tempest-VolumesSnapshotsTestJSON-1066428061-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa" status: 404 len: 109 microversion: 2.1 time: 0.045380 Nov 28 06:46:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 165/503] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:46:53 2023] GET /compute/v2.1/os-volumes/a0c5c6f4-5e37-41db-a1ef-82beb0ea41fa => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-ed16fc4b-ed6c-48a4-a9cf-d99fd9c3df47 req-0972c333-229e-45a0-9ae7-e1fca7284868 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:54 user devstack@n-api.service[64873]: DEBUG nova.compute.api [req-ed16fc4b-ed6c-48a4-a9cf-d99fd9c3df47 req-0972c333-229e-45a0-9ae7-e1fca7284868 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ed16fc4b-ed6c-48a4-a9cf-d99fd9c3df47 req-0972c333-229e-45a0-9ae7-e1fca7284868 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ed16fc4b-ed6c-48a4-a9cf-d99fd9c3df47 req-0972c333-229e-45a0-9ae7-e1fca7284868 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ed16fc4b-ed6c-48a4-a9cf-d99fd9c3df47 req-0972c333-229e-45a0-9ae7-e1fca7284868 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ed16fc4b-ed6c-48a4-a9cf-d99fd9c3df47 req-0972c333-229e-45a0-9ae7-e1fca7284868 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ed16fc4b-ed6c-48a4-a9cf-d99fd9c3df47 req-0972c333-229e-45a0-9ae7-e1fca7284868 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ed16fc4b-ed6c-48a4-a9cf-d99fd9c3df47 req-0972c333-229e-45a0-9ae7-e1fca7284868 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:54 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-ed16fc4b-ed6c-48a4-a9cf-d99fd9c3df47 req-0972c333-229e-45a0-9ae7-e1fca7284868 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments/24cf45f7-d5e5-4e17-82bf-581233d29ba3" status: 200 len: 302 microversion: 2.89 time: 0.252078 Nov 28 06:46:54 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 167/504] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 06:46:54 2023] GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments/24cf45f7-d5e5-4e17-82bf-581233d29ba3 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:46:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-97743010-5b5e-4eb6-ba81-329f4fee9779 req-97872b6d-f5d0-4579-8059-c0577373be55 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:54 user devstack@n-api.service[64872]: DEBUG nova.compute.api [req-97743010-5b5e-4eb6-ba81-329f4fee9779 req-97872b6d-f5d0-4579-8059-c0577373be55 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-97743010-5b5e-4eb6-ba81-329f4fee9779 req-97872b6d-f5d0-4579-8059-c0577373be55 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-97743010-5b5e-4eb6-ba81-329f4fee9779 req-97872b6d-f5d0-4579-8059-c0577373be55 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-97743010-5b5e-4eb6-ba81-329f4fee9779 req-97872b6d-f5d0-4579-8059-c0577373be55 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-97743010-5b5e-4eb6-ba81-329f4fee9779 req-97872b6d-f5d0-4579-8059-c0577373be55 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-97743010-5b5e-4eb6-ba81-329f4fee9779 req-97872b6d-f5d0-4579-8059-c0577373be55 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-97743010-5b5e-4eb6-ba81-329f4fee9779 req-97872b6d-f5d0-4579-8059-c0577373be55 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-97743010-5b5e-4eb6-ba81-329f4fee9779 req-97872b6d-f5d0-4579-8059-c0577373be55 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments/24cf45f7-d5e5-4e17-82bf-581233d29ba3" status: 200 len: 302 microversion: 2.89 time: 0.160935 Nov 28 06:46:55 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 173/505] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 06:46:54 2023] GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments/24cf45f7-d5e5-4e17-82bf-581233d29ba3 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lazy-loading 'services' on Instance uuid cb3a1360-d402-4962-9b05-ca0288480b10 {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:46:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-760a42b6-88ec-49cc-a7b9-0169dca37bc9 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments/24cf45f7-d5e5-4e17-82bf-581233d29ba3" status: 202 len: 0 microversion: 2.1 time: 0.262329 Nov 28 06:46:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 166/506] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:46:55 2023] DELETE /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments/24cf45f7-d5e5-4e17-82bf-581233d29ba3 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:46:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-009ddffd-eb9f-40ad-bc92-156ded4cf9bd tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:55 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-009ddffd-eb9f-40ad-bc92-156ded4cf9bd tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:46:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-009ddffd-eb9f-40ad-bc92-156ded4cf9bd tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-009ddffd-eb9f-40ad-bc92-156ded4cf9bd tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-009ddffd-eb9f-40ad-bc92-156ded4cf9bd tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-009ddffd-eb9f-40ad-bc92-156ded4cf9bd tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-009ddffd-eb9f-40ad-bc92-156ded4cf9bd tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-009ddffd-eb9f-40ad-bc92-156ded4cf9bd tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-009ddffd-eb9f-40ad-bc92-156ded4cf9bd tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085485 Nov 28 06:46:55 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 168/507] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:46:55 2023] GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-plugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] Creating event network-vif-plugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:46:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-efff30a4-fcaf-422d-99f3-44dd2d1210ef req-f13c379c-b79c-4cf8-b9ee-e0fa2478138f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073880 Nov 28 06:46:55 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 174/508] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23537de-fa1e-4cd2-8050-04ef2b911ac8", "tag": "0af514bf-1b38-47e8-97a8-7e1c3d34246a"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] Creating event network-changed:0af514bf-1b38-47e8-97a8-7e1c3d34246a for instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 on user Nov 28 06:46:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-646a3187-5baa-4187-aad8-1a6863376e85 req-f2a14d27-2ae2-4800-a5d3-e82c6538e334 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040715 Nov 28 06:46:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 167/509] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:46:56 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:56 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c9a98f37-3649-4656-9a05-d1c9a0bc64ce tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Action: 'create', calling method: .version_select at 0x7f0b0896ff40>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1626613881", "metadata": {"Type": "work"}}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:56 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c9a98f37-3649-4656-9a05-d1c9a0bc64ce tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c9a98f37-3649-4656-9a05-d1c9a0bc64ce tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.289434 Nov 28 06:46:56 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 169/510] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 06:46:56 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 291 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:46:56 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:46:56 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-da5ae3c4-b209-4e30-a04f-320d2140c8ec tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Action: 'create', calling method: .version_select at 0x7f0b03d4f910>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1279692964", "metadata": {"Type": "work"}}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:56 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-da5ae3c4-b209-4e30-a04f-320d2140c8ec tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-da5ae3c4-b209-4e30-a04f-320d2140c8ec tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013793 Nov 28 06:46:56 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 175/511] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 06:46:56 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:46:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9cfd43be-3922-44d5-bb4e-273c6a02f10d tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Action: 'create', calling method: .version_select at 0x7f0b03a70670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-831397762", "metadata": {"Type": "work"}}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9cfd43be-3922-44d5-bb4e-273c6a02f10d tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9cfd43be-3922-44d5-bb4e-273c6a02f10d tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009065 Nov 28 06:46:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 168/512] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 06:46:57 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:46:57 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-17fe5b7e-5a83-4a79-826d-2b99fd6ed8a8 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Calling method '.version_select at 0x7f0b03adfa30>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:57 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-17fe5b7e-5a83-4a79-826d-2b99fd6ed8a8 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] HTTP exception thrown: Volume tempest-invalid-1877698710 could not be found. Nov 28 06:46:57 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-17fe5b7e-5a83-4a79-826d-2b99fd6ed8a8 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Returning 404 to user: Volume tempest-invalid-1877698710 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:57 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-17fe5b7e-5a83-4a79-826d-2b99fd6ed8a8 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1877698710" status: 404 len: 99 microversion: 2.1 time: 0.041590 Nov 28 06:46:57 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 170/513] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 06:46:57 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1877698710 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 28 06:46:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-996f6d1a-dfe5-4f41-9ff2-2539982d8692 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006428 Nov 28 06:46:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 176/514] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 28 06:46:57 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 28 06:46:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-4da85596-257f-4475-9066-1a003902184c tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004427 Nov 28 06:46:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 169/515] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Nov 28 06:46:57 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 28 06:46:57 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1192bb30-f18b-4f59-b8aa-2dc869221c97 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Calling method '.version_select at 0x7f0b03be3be0>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:57 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-1192bb30-f18b-4f59-b8aa-2dc869221c97 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] HTTP exception thrown: Volume d4978499-c55c-4082-ac86-b551d30f0fe0 could not be found. Nov 28 06:46:57 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1192bb30-f18b-4f59-b8aa-2dc869221c97 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Returning 404 to user: Volume d4978499-c55c-4082-ac86-b551d30f0fe0 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:57 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1192bb30-f18b-4f59-b8aa-2dc869221c97 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d4978499-c55c-4082-ac86-b551d30f0fe0" status: 404 len: 109 microversion: 2.1 time: 0.042449 Nov 28 06:46:57 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 171/516] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:46:57 2023] DELETE /compute/v2.1/os-volumes/d4978499-c55c-4082-ac86-b551d30f0fe0 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-686b3b30-bbd5-444b-bd82-2c93c66de099 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Calling method '.version_select at 0x7f0b038ceef0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:46:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-686b3b30-bbd5-444b-bd82-2c93c66de099 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] HTTP exception thrown: Volume 5e47a826-6d81-4489-a352-4702542963ce could not be found. Nov 28 06:46:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-686b3b30-bbd5-444b-bd82-2c93c66de099 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] Returning 404 to user: Volume 5e47a826-6d81-4489-a352-4702542963ce could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:46:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-686b3b30-bbd5-444b-bd82-2c93c66de099 tempest-VolumesNegativeTest-513189040 tempest-VolumesNegativeTest-513189040-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5e47a826-6d81-4489-a352-4702542963ce" status: 404 len: 109 microversion: 2.1 time: 0.046124 Nov 28 06:46:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 177/517] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:46:57 2023] GET /compute/v2.1/os-volumes/5e47a826-6d81-4489-a352-4702542963ce => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:46:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-plugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:46:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:46:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:46:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:46:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] Creating event network-vif-plugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:46:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-2ff46e7f-10a4-4b4b-a75b-ba4249c89b0d req-e6e3bd6f-0eb9-4a15-9bfe-b0a10c4a6b32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050912 Nov 28 06:46:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 170/518] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:46:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:00 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:00 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:01 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:47:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-400fcc37-0cb6-4a63-b495-4b18b624c198 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 204 len: 0 microversion: 2.1 time: 0.257266 Nov 28 06:47:01 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 172/519] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:47:00 2023] DELETE /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:47:01 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5f223b47-12ed-4d2e-a419-a3f51c993673 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:01 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-5f223b47-12ed-4d2e-a419-a3f51c993673 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5f223b47-12ed-4d2e-a419-a3f51c993673 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5f223b47-12ed-4d2e-a419-a3f51c993673 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5f223b47-12ed-4d2e-a419-a3f51c993673 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5f223b47-12ed-4d2e-a419-a3f51c993673 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5f223b47-12ed-4d2e-a419-a3f51c993673 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5f223b47-12ed-4d2e-a419-a3f51c993673 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:01 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-5f223b47-12ed-4d2e-a419-a3f51c993673 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ee95f099b64968984fd3b9e418b048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e836995bb4af6a877468ec43d0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:01 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-5f223b47-12ed-4d2e-a419-a3f51c993673 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 200 len: 1710 microversion: 2.1 time: 0.360363 Nov 28 06:47:01 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 178/520] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:01 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 1710 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] HTTP exception thrown: Instance 317be079-9b77-4139-88a4-36efb848c025 could not be found. Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Returning 404 to user: Instance 317be079-9b77-4139-88a4-36efb848c025 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:47:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f6c06f69-ed56-40a1-a77d-c29b0fd8b372 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025" status: 404 len: 111 microversion: 2.1 time: 0.075141 Nov 28 06:47:02 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 171/521] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:47:02 2023] DELETE /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:47:02 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:02 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: 317be079-9b77-4139-88a4-36efb848c025] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:02 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=12 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:02 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] HTTP exception thrown: Instance 317be079-9b77-4139-88a4-36efb848c025 could not be found. Nov 28 06:47:02 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Returning 404 to user: Instance 317be079-9b77-4139-88a4-36efb848c025 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:47:02 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-fdd2b36d-a09d-4639-82b3-7d51124812b3 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025" status: 404 len: 111 microversion: 2.1 time: 0.163287 Nov 28 06:47:02 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 173/522] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:02 2023] GET /compute/v2.1/servers/317be079-9b77-4139-88a4-36efb848c025 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:47:02 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:02 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:02 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:47:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e5f27968-d56d-4537-93e7-e03a83632768 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" status: 204 len: 0 microversion: 2.1 time: 0.179302 Nov 28 06:47:02 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 179/523] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:47:02 2023] DELETE /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-223743d3-c20c-4a9a-9a9e-ca90cb57c898 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-223743d3-c20c-4a9a-9a9e-ca90cb57c898 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-223743d3-c20c-4a9a-9a9e-ca90cb57c898 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-223743d3-c20c-4a9a-9a9e-ca90cb57c898 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-223743d3-c20c-4a9a-9a9e-ca90cb57c898 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-223743d3-c20c-4a9a-9a9e-ca90cb57c898 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-223743d3-c20c-4a9a-9a9e-ca90cb57c898 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-223743d3-c20c-4a9a-9a9e-ca90cb57c898 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:02 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-223743d3-c20c-4a9a-9a9e-ca90cb57c898 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd89a43a3bf4952a40cd1dd07de2442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6362608255de47c3afa716e3091af3d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-223743d3-c20c-4a9a-9a9e-ca90cb57c898 tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" status: 200 len: 1497 microversion: 2.1 time: 0.429826 Nov 28 06:47:02 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 172/524] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:02 2023] GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e => generated 1497 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:47:03 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23537de-fa1e-4cd2-8050-04ef2b911ac8", "name": "network-vif-plugged", "status": "completed", "tag": "0af514bf-1b38-47e8-97a8-7e1c3d34246a"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:03 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] Creating event network-vif-plugged:0af514bf-1b38-47e8-97a8-7e1c3d34246a for instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 on user Nov 28 06:47:03 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-d77b5870-a183-4b2e-ad50-7c751d1df8a1 req-6df4fcb0-c465-4c83-8331-02e1eb05b4b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049955 Nov 28 06:47:03 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 174/525] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-5c4e5b42-4530-4054-8c45-f970263821bd req-8a8e06ec-a5e8-4c8a-af12-04cf167acd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e", "name": "network-vif-deleted", "tag": "505345c6-a079-468d-be35-64932bcaef25"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-5c4e5b42-4530-4054-8c45-f970263821bd req-8a8e06ec-a5e8-4c8a-af12-04cf167acd64 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-5c4e5b42-4530-4054-8c45-f970263821bd req-8a8e06ec-a5e8-4c8a-af12-04cf167acd64 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-5c4e5b42-4530-4054-8c45-f970263821bd req-8a8e06ec-a5e8-4c8a-af12-04cf167acd64 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-5c4e5b42-4530-4054-8c45-f970263821bd req-8a8e06ec-a5e8-4c8a-af12-04cf167acd64 service nova] Creating event network-vif-deleted:505345c6-a079-468d-be35-64932bcaef25 for instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e on user Nov 28 06:47:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-5c4e5b42-4530-4054-8c45-f970263821bd req-8a8e06ec-a5e8-4c8a-af12-04cf167acd64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065402 Nov 28 06:47:04 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 180/526] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:47:05 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fb72480-0480-4bd1-b99b-437dbcddc280"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:05 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:05 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Invalid volume: volume 5fb72480-0480-4bd1-b99b-437dbcddc280 is already attached to instances: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa Nov 28 06:47:05 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 400 to user: Invalid volume: volume 5fb72480-0480-4bd1-b99b-437dbcddc280 is already attached to instances: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:47:05 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f6439828-3d85-4857-86eb-282ab7a5bac8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121873 Nov 28 06:47:05 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 173/527] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:47:05 2023] POST /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:47:05 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:05 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:05 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23537de-fa1e-4cd2-8050-04ef2b911ac8", "name": "network-vif-plugged", "status": "completed", "tag": "0af514bf-1b38-47e8-97a8-7e1c3d34246a"}, {"server_uuid": "41240cc1-28a3-4685-9f80-68f5e37945b7", "name": "network-vif-deleted", "tag": "717f616f-b485-4c7e-83be-a80086c19692"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:05 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] Creating event network-vif-plugged:0af514bf-1b38-47e8-97a8-7e1c3d34246a for instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 on user Nov 28 06:47:05 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] Creating event network-vif-deleted:717f616f-b485-4c7e-83be-a80086c19692 for instance 41240cc1-28a3-4685-9f80-68f5e37945b7 on user Nov 28 06:47:05 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-bbd2bf1b-dc38-445e-b6a2-553c7c83a639 req-7c5b13af-4477-470a-8c39-54a4408e3897 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083946 Nov 28 06:47:05 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 181/528] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:05 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'services' on Instance uuid 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:47:06 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d3a56ba9-df3b-4f09-bf96-b501b2e14287 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-volume_attachments/5fb72480-0480-4bd1-b99b-437dbcddc280" status: 202 len: 0 microversion: 2.1 time: 0.275379 Nov 28 06:47:06 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 175/529] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:47:05 2023] DELETE /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-volume_attachments/5fb72480-0480-4bd1-b99b-437dbcddc280 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:47:06 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-bcc40183-87e7-466c-b46f-f319cbff7419 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:06 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-bcc40183-87e7-466c-b46f-f319cbff7419 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bcc40183-87e7-466c-b46f-f319cbff7419 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bcc40183-87e7-466c-b46f-f319cbff7419 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bcc40183-87e7-466c-b46f-f319cbff7419 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bcc40183-87e7-466c-b46f-f319cbff7419 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bcc40183-87e7-466c-b46f-f319cbff7419 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bcc40183-87e7-466c-b46f-f319cbff7419 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-bcc40183-87e7-466c-b46f-f319cbff7419 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059931 Nov 28 06:47:06 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 174/530] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:47:06 2023] GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:06 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] HTTP exception thrown: Instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c could not be found. Nov 28 06:47:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Returning 404 to user: Instance 77393c2a-5fb1-48ec-88bd-a13fc6f39f3c could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:47:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-de5d1c59-ea11-4112-8164-0b1a5d573c53 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c" status: 404 len: 111 microversion: 2.1 time: 0.032183 Nov 28 06:47:06 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 182/531] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:06 2023] GET /compute/v2.1/servers/77393c2a-5fb1-48ec-88bd-a13fc6f39f3c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:47:14 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:14 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] HTTP exception thrown: Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 is not attached to volume 981eddb7-039a-4cfc-9b60-ecdebff98251 Nov 28 06:47:14 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Returning 404 to user: Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 is not attached to volume 981eddb7-039a-4cfc-9b60-ecdebff98251 {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:47:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-cf399ff7-703d-4999-b322-dacc63cd06cd tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/os-volume_attachments/981eddb7-039a-4cfc-9b60-ecdebff98251" status: 404 len: 154 microversion: 2.1 time: 0.296094 Nov 28 06:47:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 176/532] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:47:14 2023] DELETE /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5/os-volume_attachments/981eddb7-039a-4cfc-9b60-ecdebff98251 => generated 154 bytes in 298 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-1938cb42-6ca8-4544-ae93-84c01984aff5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Action: 'create', calling method: .version_select at 0x7f0b03a736d0>, body: {"keypair": {"name": "tempest-keypair-847145216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrL0EOGR4mdiWZcdhcTcI7WBquXWbrzCKro8H1YNNKmzvbsUwVgzoJaFeAFhxRaxjq1JLWLCeGWKp60XemjIrD3CPVK6A2sWXxuxhmLGMLwqsn7uTzs4Bew08pPg/0/Vw=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-1938cb42-6ca8-4544-ae93-84c01984aff5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Getting quotas for project 898c9652da6145af82836b639c44458d. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-1938cb42-6ca8-4544-ae93-84c01984aff5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Getting quotas for user dde6b091a2134b83806602165f723ade and project 898c9652da6145af82836b639c44458d. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:47:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7360456d-633f-4a03-a9c8-2fffeb0ae504 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:15 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7360456d-633f-4a03-a9c8-2fffeb0ae504 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7360456d-633f-4a03-a9c8-2fffeb0ae504 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7360456d-633f-4a03-a9c8-2fffeb0ae504 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-1938cb42-6ca8-4544-ae93-84c01984aff5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.053864 Nov 28 06:47:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7360456d-633f-4a03-a9c8-2fffeb0ae504 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7360456d-633f-4a03-a9c8-2fffeb0ae504 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 175/533] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 06:47:15 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 06:47:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7360456d-633f-4a03-a9c8-2fffeb0ae504 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7360456d-633f-4a03-a9c8-2fffeb0ae504 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5", "tag": "3910f97d-105a-4142-a3ab-effc57185190"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] Creating event network-changed:3910f97d-105a-4142-a3ab-effc57185190 for instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 on user Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:47:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-92f8293d-46f6-4f67-a4ee-1c4079f427c9 req-821cc401-f264-4dd3-aee0-98f7cefeb61f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039988 Nov 28 06:47:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 176/534] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:15 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e6a15ea3-c541-4295-a91e-36947c51cda9 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" status: 204 len: 0 microversion: 2.1 time: 0.140957 Nov 28 06:47:15 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 177/535] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:47:15 2023] DELETE /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-292ee379-1513-4c3f-b237-686bee702896 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-292ee379-1513-4c3f-b237-686bee702896 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-292ee379-1513-4c3f-b237-686bee702896 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-292ee379-1513-4c3f-b237-686bee702896 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-292ee379-1513-4c3f-b237-686bee702896 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-292ee379-1513-4c3f-b237-686bee702896 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-292ee379-1513-4c3f-b237-686bee702896 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-292ee379-1513-4c3f-b237-686bee702896 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:15 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-7360456d-633f-4a03-a9c8-2fffeb0ae504 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7360456d-633f-4a03-a9c8-2fffeb0ae504 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa" status: 200 len: 1540 microversion: 2.1 time: 0.367142 Nov 28 06:47:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 183/536] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:15 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa => generated 1540 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5", "name": "network-vif-unplugged", "status": "completed", "tag": "3910f97d-105a-4142-a3ab-effc57185190"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=3,nova_api:INSERT=7 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:15 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=101,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:15 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] Creating event network-vif-unplugged:3910f97d-105a-4142-a3ab-effc57185190 for instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 on user Nov 28 06:47:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-ff26fc53-cefd-4c6c-944b-75f5aa301bb6 req-6b855648-0f17-4d8a-9f6e-be9e73307741 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042392 Nov 28 06:47:16 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 178/537] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:47:16 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-292ee379-1513-4c3f-b237-686bee702896 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73373ee05e1b4e09b5c0870750a77262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cff8da56da484d9dfee1b8118474b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-292ee379-1513-4c3f-b237-686bee702896 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" status: 200 len: 1660 microversion: 2.1 time: 0.438610 Nov 28 06:47:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 177/538] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:15 2023] GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 => generated 1660 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:47:16 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-997cb4e3-9165-46be-9f08-667c857a2e5a tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Action: 'create', calling method: .version_select at 0x7f0b03d7f640>, body: {"keypair": {"name": "tempest-keypair-651126540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiECrSGsqDJHRdDYiQmmZcKozA5CkF/dgDyzj/iDGi2l4skdIKMEoeD4X9+JIMHhLaTYDhVke5RPNrjawKChdJ7EhxdRgjS6AMqJC+lcygGJx/d9FxmcVsfbo0kDBY9oQ=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:16 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:16 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-997cb4e3-9165-46be-9f08-667c857a2e5a tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Getting quotas for project 24232ad48c7c4b6c94efc23f0682247f. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:47:16 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-997cb4e3-9165-46be-9f08-667c857a2e5a tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Getting quotas for user 59abab1396dc462cab4cd9c945c446f5 and project 24232ad48c7c4b6c94efc23f0682247f. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:47:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-997cb4e3-9165-46be-9f08-667c857a2e5a tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.066061 Nov 28 06:47:16 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 184/539] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 06:47:16 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 28 06:47:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-0022d2a3-5f9e-45ce-8be4-84e25f9f4dd7 req-ffe86e8b-a0ec-45ef-ab54-bf034151a264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5", "name": "network-vif-deleted", "tag": "3910f97d-105a-4142-a3ab-effc57185190"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0022d2a3-5f9e-45ce-8be4-84e25f9f4dd7 req-ffe86e8b-a0ec-45ef-ab54-bf034151a264 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0022d2a3-5f9e-45ce-8be4-84e25f9f4dd7 req-ffe86e8b-a0ec-45ef-ab54-bf034151a264 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0022d2a3-5f9e-45ce-8be4-84e25f9f4dd7 req-ffe86e8b-a0ec-45ef-ab54-bf034151a264 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-0022d2a3-5f9e-45ce-8be4-84e25f9f4dd7 req-ffe86e8b-a0ec-45ef-ab54-bf034151a264 service nova] Creating event network-vif-deleted:3910f97d-105a-4142-a3ab-effc57185190 for instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 on user Nov 28 06:47:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-0022d2a3-5f9e-45ce-8be4-84e25f9f4dd7 req-ffe86e8b-a0ec-45ef-ab54-bf034151a264 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032793 Nov 28 06:47:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 179/540] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1048812053", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "879e4b3b-c11a-4821-9bcf-c6f334a9c2f2"}], "security_groups": [{"name": "tempest-securitygroup--1940850216"}], "key_name": "tempest-keypair-847145216", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:17 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] validate_networks() for [('879e4b3b-c11a-4821-9bcf-c6f334a9c2f2', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:47:18 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5", "name": "network-vif-plugged", "status": "completed", "tag": "3910f97d-105a-4142-a3ab-effc57185190"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] Creating event network-vif-plugged:3910f97d-105a-4142-a3ab-effc57185190 for instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 on user Nov 28 06:47:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-49077b36-81c2-4369-93f6-df0e5fbccb21 req-6e69b16f-863f-46c2-be93-cd4dc05d48ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035073 Nov 28 06:47:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 185/541] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1427016084", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "4017cd74-3c8e-48cb-a991-090413120603"}, {"port": "57870541-c5b7-4cd3-9836-64b4ee4ffb81", "tag": "port-1"}, {"port": "7a5dfb04-4a6f-4704-9885-d38d223aeae6", "tag": "port-2"}, {"uuid": "ceec40e5-bc75-4dae-9329-401faa72d72b", "tag": "net-1"}, {"uuid": "ceec40e5-bc75-4dae-9329-401faa72d72b"}, {"uuid": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "33adf66c-17ae-4bf1-a70e-8f374e75cd95", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "23c0c714-f163-4492-af6c-f07ed4e57c74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "96aa8851-3cdf-43b9-a69e-891d458bf78b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2119844413"}], "key_name": "tempest-keypair-651126540", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:18 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] validate_networks() for [('4017cd74-3c8e-48cb-a991-090413120603', None, None, None, None, None), (None, None, '57870541-c5b7-4cd3-9836-64b4ee4ffb81', None, None, None), (None, None, '7a5dfb04-4a6f-4704-9885-d38d223aeae6', None, None, None), ('ceec40e5-bc75-4dae-9329-401faa72d72b', None, None, None, None, None), ('ceec40e5-bc75-4dae-9329-401faa72d72b', None, None, None, None, None), ('33adf66c-17ae-4bf1-a70e-8f374e75cd95', '10.2.2.100', None, None, None, None), ('33adf66c-17ae-4bf1-a70e-8f374e75cd95', '10.2.2.200', None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Getting quotas for project 898c9652da6145af82836b639c44458d. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Getting quotas for user dde6b091a2134b83806602165f723ade and project 898c9652da6145af82836b639c44458d. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:47:18 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:47:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6dbccdeb-decd-4db4-9239-b446fe03e540 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.698941 Nov 28 06:47:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 178/542] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 06:47:17 2023] POST /compute/v2.1/servers => generated 404 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 06:47:18 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b4324109-aa1a-4d16-9fbb-f0b8d25c9e3d tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:18 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-b4324109-aa1a-4d16-9fbb-f0b8d25c9e3d tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:18 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-b4324109-aa1a-4d16-9fbb-f0b8d25c9e3d tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:18 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-b4324109-aa1a-4d16-9fbb-f0b8d25c9e3d tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:18 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-b4324109-aa1a-4d16-9fbb-f0b8d25c9e3d tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b4324109-aa1a-4d16-9fbb-f0b8d25c9e3d tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3" status: 200 len: 1320 microversion: 2.49 time: 0.071810 Nov 28 06:47:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 186/543] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:47:18 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3 => generated 1320 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Getting quotas for project 24232ad48c7c4b6c94efc23f0682247f. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Getting quotas for user 59abab1396dc462cab4cd9c945c446f5 and project 24232ad48c7c4b6c94efc23f0682247f. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:47:20 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='23c0c714-f163-4492-af6c-f07ed4e57c74',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='96aa8851-3cdf-43b9-a69e-891d458bf78b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='285d1ef6-87c7-4fc9-a55e-3cfe0a0b9eb7',volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:47:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e72fca75-3298-4f80-a324-db5036427f87 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 2.788005 Nov 28 06:47:20 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 180/544] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 28 06:47:18 2023] POST /compute/v2.1/servers => generated 404 bytes in 2790 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 06:47:21 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8272998d-2d22-44ea-9835-afec2de7c4fa tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:21 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8272998d-2d22-44ea-9835-afec2de7c4fa tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:21 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-8272998d-2d22-44ea-9835-afec2de7c4fa tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:21 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-8272998d-2d22-44ea-9835-afec2de7c4fa tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:21 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-8272998d-2d22-44ea-9835-afec2de7c4fa tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8272998d-2d22-44ea-9835-afec2de7c4fa tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f" status: 200 len: 1277 microversion: 2.42 time: 0.074180 Nov 28 06:47:21 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 179/545] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:47:21 2023] GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f => generated 1277 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:47:21 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "tag": "e51be746-1419-4a95-8bc6-bcf4ed942927"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] Creating event network-changed:e51be746-1419-4a95-8bc6-bcf4ed942927 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:47:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-fd7909f2-c78a-40bc-8e02-daa5e95cc210 req-d40c44a7-f6cd-402b-a46f-330dfc67564c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037611 Nov 28 06:47:21 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 187/546] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:23 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "name": "network-vif-plugged", "status": "completed", "tag": "e51be746-1419-4a95-8bc6-bcf4ed942927"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] Creating event network-vif-plugged:e51be746-1419-4a95-8bc6-bcf4ed942927 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:47:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-bae3a25d-9011-494e-b31c-c3cac8ab6f9c req-99bafdc9-9a32-4b1b-bd64-6c30b7329000 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043797 Nov 28 06:47:23 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 181/547] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:25 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "name": "network-vif-plugged", "status": "completed", "tag": "e51be746-1419-4a95-8bc6-bcf4ed942927"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:25 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] Creating event network-vif-plugged:e51be746-1419-4a95-8bc6-bcf4ed942927 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:47:25 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-2a3b9c4f-e03b-4559-b288-7d7102f8abeb req-b0c90457-ae33-4f32-bddb-07337526b6e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028603 Nov 28 06:47:25 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 180/548] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f0602b80-ba3d-4b0e-9f6f-5714074a1684 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:27 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f0602b80-ba3d-4b0e-9f6f-5714074a1684 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0602b80-ba3d-4b0e-9f6f-5714074a1684 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0602b80-ba3d-4b0e-9f6f-5714074a1684 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0602b80-ba3d-4b0e-9f6f-5714074a1684 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0602b80-ba3d-4b0e-9f6f-5714074a1684 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0602b80-ba3d-4b0e-9f6f-5714074a1684 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f0602b80-ba3d-4b0e-9f6f-5714074a1684 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f0602b80-ba3d-4b0e-9f6f-5714074a1684 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.229106 Nov 28 06:47:27 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 188/549] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:47:27 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/os-interface => generated 282 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:28 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:28 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] Creating event network-changed:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:47:28 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-4df01daa-1451-4a7c-9137-c0805df6a7d0 req-e20c1e7e-dd82-4252-ab25-a61e44369a6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054810 Nov 28 06:47:28 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 182/550] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:28 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6778fbf8-37a2-4fc5-8371-cf0c5cbc92ff tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:28 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6778fbf8-37a2-4fc5-8371-cf0c5cbc92ff tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6778fbf8-37a2-4fc5-8371-cf0c5cbc92ff tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6778fbf8-37a2-4fc5-8371-cf0c5cbc92ff tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6778fbf8-37a2-4fc5-8371-cf0c5cbc92ff tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6778fbf8-37a2-4fc5-8371-cf0c5cbc92ff tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6778fbf8-37a2-4fc5-8371-cf0c5cbc92ff tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6778fbf8-37a2-4fc5-8371-cf0c5cbc92ff tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:28 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6778fbf8-37a2-4fc5-8371-cf0c5cbc92ff tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/ips" status: 200 len: 104 microversion: 2.1 time: 0.054185 Nov 28 06:47:28 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 181/551] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:47:28 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/ips => generated 104 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:30 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "tag": "ce346bd0-6d5d-45d0-9165-4da3207ce081"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] Creating event network-changed:ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:47:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-45255d6b-37a2-48a0-b48b-e36e68a6a1a0 req-e4c6ab4c-34ee-47c8-a151-8a31d70e131c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076383 Nov 28 06:47:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 189/552] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:47:31 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:31 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:31 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "142a655f-e1de-4c08-b7e5-e81e50cf760f"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:31 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-de0a5b8d-891f-4332-a931-12d2a166fdc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555069 Nov 28 06:47:31 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 183/553] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:47:31 2023] POST /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:32 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "tag": "57870541-c5b7-4cd3-9836-64b4ee4ffb81"}, {"name": "network-changed", "server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "tag": "7a5dfb04-4a6f-4704-9885-d38d223aeae6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:32 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:32 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=12 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Creating event network-changed:57870541-c5b7-4cd3-9836-64b4ee4ffb81 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:47:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] Creating event network-changed:7a5dfb04-4a6f-4704-9885-d38d223aeae6 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:47:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-05fcd3e9-13f4-4e7a-8d7a-252a6a09abee req-95e18a82-117d-4b06-a601-bc699937ea1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033451 Nov 28 06:47:32 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 182/554] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:32 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:34 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "tag": "0314f996-11e4-4335-8088-c85a9ec88931"}, {"name": "network-changed", "server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "tag": "40d74d10-744b-4187-8a27-c72bfc4b1a47"}, {"name": "network-changed", "server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "tag": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Creating event network-changed:0314f996-11e4-4335-8088-c85a9ec88931 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:47:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Creating event network-changed:40d74d10-744b-4187-8a27-c72bfc4b1a47 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:47:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] Creating event network-changed:8ab023f9-1a91-43d1-a020-8ecd1a6eafaf for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:47:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-e5469a66-4e00-4a2b-9b05-66967a446744 req-26792765-f11e-44fc-8261-9ac9d196ecbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.042680 Nov 28 06:47:34 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 190/555] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:34 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:36 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-7a9c9670-2e02-4452-bf58-effaa9d49984 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:36 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-7a9c9670-2e02-4452-bf58-effaa9d49984 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a9c9670-2e02-4452-bf58-effaa9d49984 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a9c9670-2e02-4452-bf58-effaa9d49984 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a9c9670-2e02-4452-bf58-effaa9d49984 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a9c9670-2e02-4452-bf58-effaa9d49984 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a9c9670-2e02-4452-bf58-effaa9d49984 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7a9c9670-2e02-4452-bf58-effaa9d49984 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:36 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-7a9c9670-2e02-4452-bf58-effaa9d49984 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:36 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-7a9c9670-2e02-4452-bf58-effaa9d49984 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a" status: 200 len: 1552 microversion: 2.1 time: 0.214502 Nov 28 06:47:36 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 184/556] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:36 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a => generated 1552 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:47:36 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "tag": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:36 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] Creating event network-changed:c1a310b8-79bf-4098-a7f8-0f1736c5dd79 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:47:36 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-3f0933e3-5fa1-4059-a02d-198d76810b6b req-175d1d7e-e1b9-40fa-8662-18c0e5629313 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033904 Nov 28 06:47:36 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 183/557] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:41 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:41 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:42 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:42 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:42 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-fa0e096b-be57-4c65-8ffc-878dd864484f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8" status: 200 len: 1691 microversion: 2.87 time: 0.677442 Nov 28 06:47:42 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 191/558] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:47:41 2023] GET /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8 => generated 1691 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:47:42 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:42 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Going to try to stop instance {{(pid=64873) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 28 06:47:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1c015a18-89c7-4ba2-9e14-8560dc6ed5cf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/action" status: 202 len: 0 microversion: 2.1 time: 0.219593 Nov 28 06:47:43 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 185/559] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:47:42 2023] POST /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:47:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-3b5fe611-f33e-46de-9afd-141b39c2ffe7 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:43 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-3b5fe611-f33e-46de-9afd-141b39c2ffe7 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3b5fe611-f33e-46de-9afd-141b39c2ffe7 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3b5fe611-f33e-46de-9afd-141b39c2ffe7 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3b5fe611-f33e-46de-9afd-141b39c2ffe7 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3b5fe611-f33e-46de-9afd-141b39c2ffe7 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3b5fe611-f33e-46de-9afd-141b39c2ffe7 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3b5fe611-f33e-46de-9afd-141b39c2ffe7 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:43 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-3b5fe611-f33e-46de-9afd-141b39c2ffe7 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-3b5fe611-f33e-46de-9afd-141b39c2ffe7 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1709 microversion: 2.1 time: 0.295792 Nov 28 06:47:43 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 184/560] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:43 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1709 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:47:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-unplugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] Creating event network-vif-unplugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:47:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-753dbe2b-bdd7-4ab2-b6fe-866828ba13a7 req-5c8404c1-62b9-4cc6-8238-1595bc916878 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040432 Nov 28 06:47:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 192/561] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:45 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-plugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] Creating event network-vif-plugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:47:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-1d8436b4-d20f-4840-bca5-e45df8f0a55f req-47de155e-7eb6-4a54-a0ee-d535d1598e67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Nov 28 06:47:45 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 186/562] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:45 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-34a39f03-e9b0-415d-8ab2-0ae1b9a6e7b1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:45 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-34a39f03-e9b0-415d-8ab2-0ae1b9a6e7b1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-34a39f03-e9b0-415d-8ab2-0ae1b9a6e7b1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-34a39f03-e9b0-415d-8ab2-0ae1b9a6e7b1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-34a39f03-e9b0-415d-8ab2-0ae1b9a6e7b1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-34a39f03-e9b0-415d-8ab2-0ae1b9a6e7b1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-34a39f03-e9b0-415d-8ab2-0ae1b9a6e7b1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-34a39f03-e9b0-415d-8ab2-0ae1b9a6e7b1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-34a39f03-e9b0-415d-8ab2-0ae1b9a6e7b1 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042492 Nov 28 06:47:45 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 185/563] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:47:45 2023] GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:47:45 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:45 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:45 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:45 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] HTTP exception thrown: Instance cb3a1360-d402-4962-9b05-ca0288480b10 is not attached to volume 24cf45f7-d5e5-4e17-82bf-581233d29ba3 Nov 28 06:47:45 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Returning 404 to user: Instance cb3a1360-d402-4962-9b05-ca0288480b10 is not attached to volume 24cf45f7-d5e5-4e17-82bf-581233d29ba3 {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:47:45 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-02a5e1b1-a62e-4ac3-9095-5bdebfe360ee tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments/24cf45f7-d5e5-4e17-82bf-581233d29ba3" status: 404 len: 154 microversion: 2.1 time: 0.111681 Nov 28 06:47:45 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 193/564] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:47:45 2023] DELETE /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10/os-volume_attachments/24cf45f7-d5e5-4e17-82bf-581233d29ba3 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:47:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:49 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:50 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:47:50 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0bc2cf14-61af-4bb5-8fb1-19f3f0bc476d tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10" status: 204 len: 0 microversion: 2.1 time: 0.378809 Nov 28 06:47:50 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 187/565] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:47:49 2023] DELETE /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:47:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-2c074bb6-f45f-432d-9012-640f4aea128a tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:50 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-2c074bb6-f45f-432d-9012-640f4aea128a tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c074bb6-f45f-432d-9012-640f4aea128a tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c074bb6-f45f-432d-9012-640f4aea128a tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c074bb6-f45f-432d-9012-640f4aea128a tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c074bb6-f45f-432d-9012-640f4aea128a tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c074bb6-f45f-432d-9012-640f4aea128a tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2c074bb6-f45f-432d-9012-640f4aea128a tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:50 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-2c074bb6-f45f-432d-9012-640f4aea128a tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cff054e141e43feb19997a67027f5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc4dd85b0ff45bd8e13a8266b18b843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-2c074bb6-f45f-432d-9012-640f4aea128a tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10" status: 200 len: 1698 microversion: 2.1 time: 0.274698 Nov 28 06:47:50 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 186/566] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:50 2023] GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10 => generated 1698 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:47:50 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3a1360-d402-4962-9b05-ca0288480b10", "name": "network-vif-unplugged", "status": "completed", "tag": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:50 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:47:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] Creating event network-vif-unplugged:a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance cb3a1360-d402-4962-9b05-ca0288480b10 on user Nov 28 06:47:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-4c3bb86b-c5ce-4cf0-83d0-ac03270accd6 req-59bd5cda-685f-44ae-a5d8-9f14e23cdb43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047395 Nov 28 06:47:50 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 194/567] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:51 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:51 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] HTTP exception thrown: Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 could not be found. Nov 28 06:47:51 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Returning 404 to user: Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:47:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-aebd530f-38cf-4465-a132-0928f4313eb2 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 404 len: 111 microversion: 2.1 time: 0.028778 Nov 28 06:47:51 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 188/568] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:51 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:47:51 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:51 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:51 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] HTTP exception thrown: Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 could not be found. Nov 28 06:47:51 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Returning 404 to user: Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:47:51 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e0930190-14db-476e-ac96-bfa6e74a0cf0 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030530 Nov 28 06:47:51 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 187/569] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:47:51 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:47:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-190f76e8-ad2e-436a-889a-3ee75c0d891e req-d837145d-ae0b-4c7e-8538-fb304d873922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3a1360-d402-4962-9b05-ca0288480b10", "name": "network-vif-deleted", "tag": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-190f76e8-ad2e-436a-889a-3ee75c0d891e req-d837145d-ae0b-4c7e-8538-fb304d873922 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-190f76e8-ad2e-436a-889a-3ee75c0d891e req-d837145d-ae0b-4c7e-8538-fb304d873922 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-190f76e8-ad2e-436a-889a-3ee75c0d891e req-d837145d-ae0b-4c7e-8538-fb304d873922 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-190f76e8-ad2e-436a-889a-3ee75c0d891e req-d837145d-ae0b-4c7e-8538-fb304d873922 service nova] Creating event network-vif-deleted:a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance cb3a1360-d402-4962-9b05-ca0288480b10 on user Nov 28 06:47:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-190f76e8-ad2e-436a-889a-3ee75c0d891e req-d837145d-ae0b-4c7e-8538-fb304d873922 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029960 Nov 28 06:47:52 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 195/570] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:52 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3a1360-d402-4962-9b05-ca0288480b10", "name": "network-vif-plugged", "status": "completed", "tag": "a89c6a82-52b2-4afa-b8e5-01cf52d7bb27"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] Creating event network-vif-plugged:a89c6a82-52b2-4afa-b8e5-01cf52d7bb27 for instance cb3a1360-d402-4962-9b05-ca0288480b10 on user Nov 28 06:47:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-889549a0-8fd2-4dcb-bd80-119af6acc706 req-1d43a509-416e-4968-8794-6a5329064cde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029531 Nov 28 06:47:52 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 189/571] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:47:53 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:53 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] [instance: d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] HTTP exception thrown: Instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e could not be found. Nov 28 06:47:53 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] Returning 404 to user: Instance d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:47:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-1361b0f1-fe32-41e5-b142-602b3c3a534c tempest-ServersNegativeTestJSON-1666481027 tempest-ServersNegativeTestJSON-1666481027-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e" status: 404 len: 111 microversion: 2.1 time: 0.028575 Nov 28 06:47:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 188/572] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:53 2023] GET /compute/v2.1/servers/d3543b3c-fe7e-4f7c-af45-0fd9e49b1a2e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:47:56 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a100fed3-2583-4dae-a0a3-0cb5fc673753 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:56 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a100fed3-2583-4dae-a0a3-0cb5fc673753 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a100fed3-2583-4dae-a0a3-0cb5fc673753 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a100fed3-2583-4dae-a0a3-0cb5fc673753 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a100fed3-2583-4dae-a0a3-0cb5fc673753 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a100fed3-2583-4dae-a0a3-0cb5fc673753 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a100fed3-2583-4dae-a0a3-0cb5fc673753 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a100fed3-2583-4dae-a0a3-0cb5fc673753 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a100fed3-2583-4dae-a0a3-0cb5fc673753 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052826 Nov 28 06:47:56 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 196/573] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:47:56 2023] GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:47:56 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:56 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:56 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:47:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-aaaa944f-988a-4229-847c-4951b6a88c38 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" status: 204 len: 0 microversion: 2.1 time: 0.149998 Nov 28 06:47:56 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 190/574] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:47:56 2023] DELETE /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:47:56 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5833907d-a724-49a8-966c-c633eef000ab tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:47:56 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-5833907d-a724-49a8-966c-c633eef000ab tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:47:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5833907d-a724-49a8-966c-c633eef000ab tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5833907d-a724-49a8-966c-c633eef000ab tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5833907d-a724-49a8-966c-c633eef000ab tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5833907d-a724-49a8-966c-c633eef000ab tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5833907d-a724-49a8-966c-c633eef000ab tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5833907d-a724-49a8-966c-c633eef000ab tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:56 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-5833907d-a724-49a8-966c-c633eef000ab tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:47:56 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5833907d-a724-49a8-966c-c633eef000ab tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" status: 200 len: 1668 microversion: 2.1 time: 0.250363 Nov 28 06:47:56 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 189/575] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:47:56 2023] GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa => generated 1668 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:47:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa", "name": "network-vif-unplugged", "status": "completed", "tag": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] Creating event network-vif-unplugged:b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa on user Nov 28 06:47:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-ce318e4b-bb69-4591-b3ad-cab203734d45 req-65efc873-f353-449e-929c-bb9731d3a263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038810 Nov 28 06:47:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 197/576] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:58 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-fd712c25-e13d-4153-9c20-384b94c52265 req-2b728842-114f-41f2-b225-7f1815ed9f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa", "name": "network-vif-deleted", "tag": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-fd712c25-e13d-4153-9c20-384b94c52265 req-2b728842-114f-41f2-b225-7f1815ed9f72 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-fd712c25-e13d-4153-9c20-384b94c52265 req-2b728842-114f-41f2-b225-7f1815ed9f72 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-fd712c25-e13d-4153-9c20-384b94c52265 req-2b728842-114f-41f2-b225-7f1815ed9f72 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:58 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-fd712c25-e13d-4153-9c20-384b94c52265 req-2b728842-114f-41f2-b225-7f1815ed9f72 service nova] Creating event network-vif-deleted:b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa on user Nov 28 06:47:58 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-fd712c25-e13d-4153-9c20-384b94c52265 req-2b728842-114f-41f2-b225-7f1815ed9f72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030283 Nov 28 06:47:58 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 191/577] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:47:59 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e43d2c-f91b-44cb-9cfe-a0e3682a12aa", "name": "network-vif-plugged", "status": "completed", "tag": "b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:47:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:47:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:47:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:47:59 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] Creating event network-vif-plugged:b4fa043b-e171-48f3-8bfb-c48e1e1b1d4f for instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa on user Nov 28 06:47:59 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-6d8e25fd-5065-4f8a-a31e-e9c29e72a2b1 req-9ab58ffe-a89b-4457-8c3e-930d0d529c47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031385 Nov 28 06:47:59 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 190/578] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:47:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:02 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:02 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] HTTP exception thrown: Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 could not be found. Nov 28 06:48:02 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Returning 404 to user: Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:48:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-98ddc96f-f379-459a-93a6-c06190ef4342 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 404 len: 111 microversion: 2.1 time: 0.033233 Nov 28 06:48:02 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 198/579] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:48:02 2023] DELETE /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:48:02 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:02 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] [instance: 41240cc1-28a3-4685-9f80-68f5e37945b7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:02 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] HTTP exception thrown: Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 could not be found. Nov 28 06:48:02 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Returning 404 to user: Instance 41240cc1-28a3-4685-9f80-68f5e37945b7 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:48:02 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e6c1ab86-ea86-4350-9659-0b308189ec99 tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7" status: 404 len: 111 microversion: 2.1 time: 0.032674 Nov 28 06:48:02 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 192/580] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:02 2023] GET /compute/v2.1/servers/41240cc1-28a3-4685-9f80-68f5e37945b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:48:02 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5c998689-077d-4e32-9032-df2024fd106a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] Calling method '.version_select at 0x7f0b03a0b7f0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5c998689-077d-4e32-9032-df2024fd106a tempest-ServerActionsTestOtherB-1422366079 tempest-ServerActionsTestOtherB-1422366079-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612163949" status: 202 len: 0 microversion: 2.1 time: 0.022533 Nov 28 06:48:02 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 191/581] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 06:48:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612163949 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:48:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:06 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] [instance: 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] HTTP exception thrown: Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 could not be found. Nov 28 06:48:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Returning 404 to user: Instance 8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:48:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-42600a89-ffa7-4acd-bf22-baf4684d0f3a tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5" status: 404 len: 111 microversion: 2.1 time: 0.032639 Nov 28 06:48:06 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 199/582] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:06 2023] GET /compute/v2.1/servers/8309cbc9-d376-4a0b-b2e8-f0ba62cf25d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:08 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0b4d5aee-f370-4da9-ba24-8db3e119c3ca tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3" status: 200 len: 1628 microversion: 2.49 time: 0.238237 Nov 28 06:48:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 193/583] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:48:08 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3 => generated 1628 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=37 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:11 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:11 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5d7c38c0-8b69-4f0b-8d84-86598c5067da tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f" status: 200 len: 1871 microversion: 2.42 time: 0.688757 Nov 28 06:48:11 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 192/584] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:48:11 2023] GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f => generated 1871 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:48:11 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-ac02a776-61a2-497f-943a-c961cb1588c2 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] Calling method '.version_select at 0x7f0b039030a0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:11 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-ac02a776-61a2-497f-943a-c961cb1588c2 tempest-TestStampPattern-415121645 tempest-TestStampPattern-415121645-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1173073735" status: 202 len: 0 microversion: 2.1 time: 0.027133 Nov 28 06:48:11 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 200/585] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:48:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1173073735 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:48:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "ce346bd0-6d5d-45d0-9165-4da3207ce081"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] Creating event network-vif-plugged:ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-142d7a51-60c2-4bf4-99c1-5e4f50d979cb req-f0a055ec-2150-40d5-bc03-9fc3184e72dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054680 Nov 28 06:48:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 194/586] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:12 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "7a5dfb04-4a6f-4704-9885-d38d223aeae6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] Creating event network-vif-plugged:7a5dfb04-4a6f-4704-9885-d38d223aeae6 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-2e08d533-e32c-41c6-8f1a-bfc4f9b1618b req-606667c9-c84f-4b87-9f0f-90689c5682e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072425 Nov 28 06:48:13 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 193/587] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:13 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "0314f996-11e4-4335-8088-c85a9ec88931"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:13 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] Creating event network-vif-plugged:0314f996-11e4-4335-8088-c85a9ec88931 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:13 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-cd6452e3-960a-4cdb-a8da-b8c4315c8e14 req-2bd04309-c87d-48bb-a2ed-9bbabff621e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038507 Nov 28 06:48:13 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 201/588] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:14 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "ce346bd0-6d5d-45d0-9165-4da3207ce081"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "57870541-c5b7-4cd3-9836-64b4ee4ffb81"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "57870541-c5b7-4cd3-9836-64b4ee4ffb81"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "40d74d10-744b-4187-8a27-c72bfc4b1a47"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Creating event network-vif-plugged:ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Creating event network-vif-plugged:57870541-c5b7-4cd3-9836-64b4ee4ffb81 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Creating event network-vif-plugged:57870541-c5b7-4cd3-9836-64b4ee4ffb81 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] Creating event network-vif-plugged:40d74d10-744b-4187-8a27-c72bfc4b1a47 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-3e736515-d316-4600-9d12-1ab1ecfd56ca req-d0d95ca1-83f0-4849-bf70-c1b02bb538bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.083829 Nov 28 06:48:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 195/589] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:14 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "7a5dfb04-4a6f-4704-9885-d38d223aeae6"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Creating event network-vif-plugged:7a5dfb04-4a6f-4704-9885-d38d223aeae6 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Creating event network-vif-plugged:c1a310b8-79bf-4098-a7f8-0f1736c5dd79 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] Creating event network-vif-plugged:c1a310b8-79bf-4098-a7f8-0f1736c5dd79 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-4ca69962-1fbb-45a9-b540-fce55c15018b req-2ab3637e-de90-41db-85b5-7407c0e6679c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035178 Nov 28 06:48:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 194/590] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:15 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "0314f996-11e4-4335-8088-c85a9ec88931"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Creating event network-vif-plugged:0314f996-11e4-4335-8088-c85a9ec88931 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Creating event network-vif-plugged:8ab023f9-1a91-43d1-a020-8ecd1a6eafaf for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] Creating event network-vif-plugged:8ab023f9-1a91-43d1-a020-8ecd1a6eafaf for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-a2157265-fa6f-4497-9b34-dc5d784240cf req-b4b7295e-f1c9-4a39-9c3f-cfe819b4137f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.063128 Nov 28 06:48:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 202/591] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:15 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b6be9dad-7dd7-4f8f-bd75-b3f8ea32e6bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:16 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-b6be9dad-7dd7-4f8f-bd75-b3f8ea32e6bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6be9dad-7dd7-4f8f-bd75-b3f8ea32e6bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6be9dad-7dd7-4f8f-bd75-b3f8ea32e6bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6be9dad-7dd7-4f8f-bd75-b3f8ea32e6bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6be9dad-7dd7-4f8f-bd75-b3f8ea32e6bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6be9dad-7dd7-4f8f-bd75-b3f8ea32e6bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6be9dad-7dd7-4f8f-bd75-b3f8ea32e6bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:16 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "40d74d10-744b-4187-8a27-c72bfc4b1a47"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:16 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] Creating event network-vif-plugged:40d74d10-744b-4187-8a27-c72bfc4b1a47 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:48:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-9ffa3483-b98d-46b7-a43c-33cc5045d5fa req-e36c41dd-0930-463e-9703-52d06156c919 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034790 Nov 28 06:48:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 195/592] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-b6be9dad-7dd7-4f8f-bd75-b3f8ea32e6bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.525166 Nov 28 06:48:16 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 196/593] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:48:15 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/os-interface => generated 282 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1d24d9f2-dc08-473d-89dc-ac5b9a972945 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:17 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1d24d9f2-dc08-473d-89dc-ac5b9a972945 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:17 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d24d9f2-dc08-473d-89dc-ac5b9a972945 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d24d9f2-dc08-473d-89dc-ac5b9a972945 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d24d9f2-dc08-473d-89dc-ac5b9a972945 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d24d9f2-dc08-473d-89dc-ac5b9a972945 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d24d9f2-dc08-473d-89dc-ac5b9a972945 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d24d9f2-dc08-473d-89dc-ac5b9a972945 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:17 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1d24d9f2-dc08-473d-89dc-ac5b9a972945 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:17 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1d24d9f2-dc08-473d-89dc-ac5b9a972945 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa" status: 200 len: 1540 microversion: 2.1 time: 0.524638 Nov 28 06:48:17 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 203/594] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:17 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa => generated 1540 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:48:18 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ceba6e2-fc04-4dc6-ab19-055561d21e27"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:18 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8ca60dbf-47ba-4205-b0db-6f0583c9a809 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "POST /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304792 Nov 28 06:48:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 196/595] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:48:18 2023] POST /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:18 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:18 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] Creating event network-changed:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:48:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-14b9799d-3a30-4c8e-8f3e-cf81ed8117c3 req-80fa1da3-8f7c-4eed-99c7-2fa7a1d3d5bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048404 Nov 28 06:48:18 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 197/596] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4d887505-7b5e-4bb9-a060-44d88987eed0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4d887505-7b5e-4bb9-a060-44d88987eed0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=25 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d887505-7b5e-4bb9-a060-44d88987eed0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d887505-7b5e-4bb9-a060-44d88987eed0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d887505-7b5e-4bb9-a060-44d88987eed0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d887505-7b5e-4bb9-a060-44d88987eed0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d887505-7b5e-4bb9-a060-44d88987eed0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4d887505-7b5e-4bb9-a060-44d88987eed0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:30 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-4d887505-7b5e-4bb9-a060-44d88987eed0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4d887505-7b5e-4bb9-a060-44d88987eed0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa" status: 200 len: 1705 microversion: 2.1 time: 0.356047 Nov 28 06:48:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 204/597] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:30 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa => generated 1705 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:48:30 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:30 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:30 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestOtherA-server-512573953", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:30 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: dict_keys(['metadata_items']) {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for user b7b9a26798e14399ac1a70568432485e and project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: dict_keys(['metadata_items']) {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:31 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c682e013-6404-4b1e-bdb5-62c8bede0634 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "POST /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/action" status: 202 len: 1161 microversion: 2.1 time: 0.622181 Nov 28 06:48:31 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 197/598] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Nov 28 06:48:30 2023] POST /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/action => generated 1161 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 28 06:48:31 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-302bc7da-6988-4f44-9924-bd51dd022b4d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:31 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-302bc7da-6988-4f44-9924-bd51dd022b4d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:31 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:31 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-302bc7da-6988-4f44-9924-bd51dd022b4d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-302bc7da-6988-4f44-9924-bd51dd022b4d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-302bc7da-6988-4f44-9924-bd51dd022b4d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-302bc7da-6988-4f44-9924-bd51dd022b4d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-302bc7da-6988-4f44-9924-bd51dd022b4d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-302bc7da-6988-4f44-9924-bd51dd022b4d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:32 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-302bc7da-6988-4f44-9924-bd51dd022b4d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:32 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-302bc7da-6988-4f44-9924-bd51dd022b4d tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa" status: 200 len: 1732 microversion: 2.1 time: 0.635731 Nov 28 06:48:32 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 198/599] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:31 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa => generated 1732 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:48:32 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "name": "network-vif-unplugged", "status": "completed", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] Creating event network-vif-unplugged:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:48:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-f4e5fd4a-185e-4549-acfd-b1af48f00ef1 req-7b7834df-7aa8-4920-9321-f76e06867bdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.309173 Nov 28 06:48:32 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 205/600] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:33 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f207b0c7-809d-4cd7-8a5c-319ff2863173 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:33 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f207b0c7-809d-4cd7-8a5c-319ff2863173 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f207b0c7-809d-4cd7-8a5c-319ff2863173 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f207b0c7-809d-4cd7-8a5c-319ff2863173 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f207b0c7-809d-4cd7-8a5c-319ff2863173 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f207b0c7-809d-4cd7-8a5c-319ff2863173 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f207b0c7-809d-4cd7-8a5c-319ff2863173 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f207b0c7-809d-4cd7-8a5c-319ff2863173 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:33 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-f207b0c7-809d-4cd7-8a5c-319ff2863173 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f207b0c7-809d-4cd7-8a5c-319ff2863173 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1686 microversion: 2.1 time: 0.218068 Nov 28 06:48:33 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 198/601] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:33 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1686 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:48:34 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "name": "network-vif-plugged", "status": "completed", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] Creating event network-vif-plugged:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:48:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-ced12372-7a5f-46e9-9790-7eed7901fda4 req-c2d57e57-6877-42e2-9b9e-f55d7706689d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032689 Nov 28 06:48:34 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 199/602] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:36 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-cb45ee53-818f-4c62-bd02-d535119c0a39 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:36 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-cb45ee53-818f-4c62-bd02-d535119c0a39 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cb45ee53-818f-4c62-bd02-d535119c0a39 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cb45ee53-818f-4c62-bd02-d535119c0a39 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cb45ee53-818f-4c62-bd02-d535119c0a39 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cb45ee53-818f-4c62-bd02-d535119c0a39 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cb45ee53-818f-4c62-bd02-d535119c0a39 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cb45ee53-818f-4c62-bd02-d535119c0a39 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:36 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-cb45ee53-818f-4c62-bd02-d535119c0a39 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.200052 Nov 28 06:48:36 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 206/603] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:48:36 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-interface => generated 282 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:37 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] Creating event network-changed:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:48:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-34e1adcf-f0d4-483e-b0c0-b52adc1f0fba req-86b577b8-096d-4e6c-b071-226dbcddbcf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050085 Nov 28 06:48:38 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 199/604] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "daa2eb88-295a-4c93-81a0-3f799e732e97"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:38 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9624d880-94bb-40cd-8c01-cf9da98d7700 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345955 Nov 28 06:48:38 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 200/605] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:48:38 2023] POST /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:40 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] [instance: cb3a1360-d402-4962-9b05-ca0288480b10] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:40 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ac22e8f1-6e92-482c-afb8-4d5eed7a1e55 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Action: 'create', calling method: .version_select at 0x7f0b03cee440>, body: {"keypair": {"name": "tempest-keypair-1581719119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODxKF/OFbZznyIWUBEYrF6APCNw+niqepzasaoANx1P3W6SKf9cpMx/jUf/m5UakKfcm2/aZgHCrOgNhmzzwVVzs4/c9tpFTJFkpBpSq6wrMu+eS98BH7Ve1fQI0zJUKQ=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] HTTP exception thrown: Instance cb3a1360-d402-4962-9b05-ca0288480b10 could not be found. Nov 28 06:48:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Returning 404 to user: Instance cb3a1360-d402-4962-9b05-ca0288480b10 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:48:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-166adaa6-f190-4214-b442-9da6d5a29927 tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10" status: 404 len: 111 microversion: 2.1 time: 0.053106 Nov 28 06:48:40 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 207/606] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:40 2023] GET /compute/v2.1/servers/cb3a1360-d402-4962-9b05-ca0288480b10 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:48:40 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-ac22e8f1-6e92-482c-afb8-4d5eed7a1e55 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Getting quotas for project 55617103c9e348b3bc963810362acb6b. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:48:40 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-f5647bb7-80e0-4d7b-842f-4b7f1756352e tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] Calling method '.version_select at 0x7f0b03a9ac20>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:40 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-ac22e8f1-6e92-482c-afb8-4d5eed7a1e55 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Getting quotas for user b1b878f5054743d690f01e77e7425371 and project 55617103c9e348b3bc963810362acb6b. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:48:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-f5647bb7-80e0-4d7b-842f-4b7f1756352e tempest-TestServerVolumeAttachScenarioOldVersion-296558585 tempest-TestServerVolumeAttachScenarioOldVersion-296558585-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-676620164" status: 202 len: 0 microversion: 2.1 time: 0.028148 Nov 28 06:48:40 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 201/607] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 06:48:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-676620164 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:48:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ac22e8f1-6e92-482c-afb8-4d5eed7a1e55 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072241 Nov 28 06:48:40 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 200/608] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:48:40 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:42 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-341725687"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:42 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:42 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachmentScenario-server-368773156", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "21375faf-748b-4eae-8d27-6e8a507aa6cc"}], "security_groups": [{"name": "tempest-securitygroup--657432333"}], "key_name": "tempest-keypair-1581719119", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:42 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] validate_networks() for [('21375faf-748b-4eae-8d27-6e8a507aa6cc', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Getting quotas for project 55617103c9e348b3bc963810362acb6b. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Getting quotas for user b1b878f5054743d690f01e77e7425371 and project 55617103c9e348b3bc963810362acb6b. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:48:43 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:48:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-46e6a2ed-6ec4-4513-91e4-85c69eae85dc tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.110589 Nov 28 06:48:43 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 202/609] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:48:42 2023] POST /compute/v2.1/servers => generated 403 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:48:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b47949f1-ff91-4623-aaab-c21ebd897328 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:43 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-b47949f1-ff91-4623-aaab-c21ebd897328 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-9a6d7aaf-b014-40d7-8b1f-ce05c386adc5 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8/action" status: 202 len: 52 microversion: 2.87 time: 1.143224 Nov 28 06:48:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 208/610] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 06:48:42 2023] POST /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8/action => generated 52 bytes in 1146 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 28 06:48:43 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-b47949f1-ff91-4623-aaab-c21ebd897328 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b878f5054743d690f01e77e7425371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55617103c9e348b3bc963810362acb6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b47949f1-ff91-4623-aaab-c21ebd897328 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813" status: 200 len: 1243 microversion: 2.1 time: 0.095123 Nov 28 06:48:43 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 201/611] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:43 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813 => generated 1243 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:48:47 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:47 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:47 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa could not be found. Nov 28 06:48:47 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:48:47 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9d93ccc0-45b0-4399-8d85-ed5182b4fea6 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" status: 404 len: 111 microversion: 2.1 time: 0.377032 Nov 28 06:48:47 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 203/612] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:46 2023] GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa => generated 111 bytes in 378 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:48:47 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9b091c8e-4fbc-437c-982b-d8a3a1d26916 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '.version_select at 0x7f0b038cf2e0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-9b091c8e-4fbc-437c-982b-d8a3a1d26916 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434653657" status: 202 len: 0 microversion: 2.1 time: 0.155093 Nov 28 06:48:47 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 209/613] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 06:48:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434653657 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:48:47 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab422771-7c11-4074-b4a6-d793c790e813", "tag": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:47 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] Creating event network-changed:5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance ab422771-7c11-4074-b4a6-d793c790e813 on user Nov 28 06:48:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-f17c84e1-4cd4-4b6f-a625-cf0b9b1cda37 req-41eae2af-e7a6-478e-a80a-46c2bfb4bd41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063983 Nov 28 06:48:48 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 202/614] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:48 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-28f1b14b-2da9-4e90-834c-d5445c43614e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: .version_select at 0x7f0b03adff40>, body: {"keypair": {"name": "tempest-keypair-923733588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ9uweIxjBCanmmT+01e+MV5bbT1foqRxFeoxQiitX1GY9EPkJhtQPbVJG1tw3les1DVgMZDuDWvExHqyXpGGDwn9KjzAwnApDu7CqUAGqzvyLltupdS+va65XaMVonDQ=="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:48 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-28f1b14b-2da9-4e90-834c-d5445c43614e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for project 5df9ec769206481e8dad48a6461c46ba. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:48:48 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-28f1b14b-2da9-4e90-834c-d5445c43614e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for user 05e396090c4b4a8995d8d2e66c8b3db0 and project 5df9ec769206481e8dad48a6461c46ba. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:48:48 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-28f1b14b-2da9-4e90-834c-d5445c43614e tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043258 Nov 28 06:48:48 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 204/615] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:48:48 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:50 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1101632916", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "202f7756-ce64-4307-8a6b-b7601305e6b7"}], "security_groups": [{"name": "tempest-securitygroup--1754940558"}], "key_name": "tempest-keypair-923733588", "user_data": "}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab422771-7c11-4074-b4a6-d793c790e813", "name": "network-vif-plugged", "status": "completed", "tag": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] Creating event network-vif-plugged:5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance ab422771-7c11-4074-b4a6-d793c790e813 on user Nov 28 06:48:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-6353dd5f-754f-466c-9211-d046f9d3127e req-20964b30-3e01-4a21-9f95-3c9ac7616fd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045906 Nov 28 06:48:50 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 203/616] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:50 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] validate_networks() for [('202f7756-ce64-4307-8a6b-b7601305e6b7', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for project 5df9ec769206481e8dad48a6461c46ba. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Getting quotas for user 05e396090c4b4a8995d8d2e66c8b3db0 and project 5df9ec769206481e8dad48a6461c46ba. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:48:51 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:48:51 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-45460e90-25f8-44a0-9b15-b22410346019 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.222863 Nov 28 06:48:51 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 210/617] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:48:50 2023] POST /compute/v2.1/servers => generated 400 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:48:51 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5438bd0b-c9d5-4ae8-8a44-34c4f3e15960 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:51 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5438bd0b-c9d5-4ae8-8a44-34c4f3e15960 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:51 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-5438bd0b-c9d5-4ae8-8a44-34c4f3e15960 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5438bd0b-c9d5-4ae8-8a44-34c4f3e15960 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" status: 200 len: 1233 microversion: 2.1 time: 0.184977 Nov 28 06:48:52 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 205/618] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:51 2023] GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db => generated 1233 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:52 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:52 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b089e3ff-215d-4f88-8b4b-ffa44e12d667 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8" status: 200 len: 1691 microversion: 2.87 time: 0.256611 Nov 28 06:48:52 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 204/619] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:48:52 2023] GET /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8 => generated 1691 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:48:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab422771-7c11-4074-b4a6-d793c790e813", "name": "network-vif-plugged", "status": "completed", "tag": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] Creating event network-vif-plugged:5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance ab422771-7c11-4074-b4a6-d793c790e813 on user Nov 28 06:48:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-e8eedc56-b49c-4988-b994-d94ebe3553b1 req-9ed90fff-5e7d-425c-8f9c-8995a0dc96e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061264 Nov 28 06:48:52 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 211/620] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db", "tag": "b7c5e041-ed7b-4c47-96b6-dbebd8356786"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:55 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] Creating event network-changed:b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db on user Nov 28 06:48:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-2749a949-f0f2-4385-8bfb-e717a7908eff req-41e1142d-986a-4cf6-a704-822532aff9dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080067 Nov 28 06:48:55 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 206/621] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:48:58 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:48:58 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:58 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:58 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'flavor' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:48:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9ce7eeb6-df51-4d8e-830e-82a10a1c52cc tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/action" status: 200 len: 32 microversion: 2.1 time: 0.231555 Nov 28 06:48:58 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 205/622] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:48:58 2023] POST /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/action => generated 32 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:48:58 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-8eebe856-bbbb-4123-ad36-88976e3a465c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:48:58 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-8eebe856-bbbb-4123-ad36-88976e3a465c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:48:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8eebe856-bbbb-4123-ad36-88976e3a465c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8eebe856-bbbb-4123-ad36-88976e3a465c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8eebe856-bbbb-4123-ad36-88976e3a465c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8eebe856-bbbb-4123-ad36-88976e3a465c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8eebe856-bbbb-4123-ad36-88976e3a465c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8eebe856-bbbb-4123-ad36-88976e3a465c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:58 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db", "name": "network-vif-plugged", "status": "completed", "tag": "b7c5e041-ed7b-4c47-96b6-dbebd8356786"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:48:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:48:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:48:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:48:58 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] Creating event network-vif-plugged:b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db on user Nov 28 06:48:58 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-0a183476-b850-4ddb-8f27-2a1c26c37940 req-7854856f-2afd-4c3c-b73b-04fae8af37e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037897 Nov 28 06:48:58 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 207/623] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:48:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:48:59 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-8eebe856-bbbb-4123-ad36-88976e3a465c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:48:59 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-8eebe856-bbbb-4123-ad36-88976e3a465c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a" status: 200 len: 1721 microversion: 2.1 time: 0.513654 Nov 28 06:48:59 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 212/624] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:48:58 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a => generated 1721 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:49:01 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db", "name": "network-vif-plugged", "status": "completed", "tag": "b7c5e041-ed7b-4c47-96b6-dbebd8356786"}, {"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-unplugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}, {"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-plugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:01 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:01 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:01 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:01 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Creating event network-vif-plugged:b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db on user Nov 28 06:49:01 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Creating event network-vif-unplugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:49:01 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] Creating event network-vif-plugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:49:01 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-44ae8695-f6b6-430d-94fd-a6bbdc55995d req-90c93773-83eb-4270-920f-6dfb28c1026c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.124973 Nov 28 06:49:01 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 206/625] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:01 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:01 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "name": "network-vif-plugged", "status": "completed", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] Creating event network-vif-plugged:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:49:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-970e3746-2577-4368-881f-ec4c588f2c01 req-bcf0ce88-d63f-44ab-9af7-a583fd2408d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044603 Nov 28 06:49:01 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 208/626] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:01 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:01 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:01 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:01 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:01 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:02 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:02 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:02 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-6dca826f-7e22-4df8-93cc-1d589116a532 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f" status: 200 len: 2827 microversion: 2.42 time: 0.968719 Nov 28 06:49:02 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 213/627] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:49:01 2023] GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f => generated 2827 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:49:03 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "name": "network-vif-plugged", "status": "completed", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:03 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] Creating event network-vif-plugged:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:49:03 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-25c66406-a72e-42fa-bb24-98f7d0ea643d req-c8d8d665-1799-475f-9afb-ac9f646de4eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035562 Nov 28 06:49:03 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 207/628] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:03 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-plugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:03 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=12 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] Creating event network-vif-plugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:49:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-8cd54c3a-cee0-4945-8ed7-83b3e3b8a479 req-189bb9a0-90f8-412c-90a2-629c3c182ed4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237442 Nov 28 06:49:04 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 209/629] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-plugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] Creating event network-vif-plugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:49:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-0bde9365-2dbd-41bb-8e6d-0ecf79751f21 req-afcd37f6-8661-49bf-9d9e-396916aaa428 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069064 Nov 28 06:49:06 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 214/630] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:08 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ed982bcc-c455-4c91-a305-4e4f04ba03ee tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:08 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ed982bcc-c455-4c91-a305-4e4f04ba03ee tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ed982bcc-c455-4c91-a305-4e4f04ba03ee tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ed982bcc-c455-4c91-a305-4e4f04ba03ee tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ed982bcc-c455-4c91-a305-4e4f04ba03ee tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ed982bcc-c455-4c91-a305-4e4f04ba03ee tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ed982bcc-c455-4c91-a305-4e4f04ba03ee tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ed982bcc-c455-4c91-a305-4e4f04ba03ee tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ed982bcc-c455-4c91-a305-4e4f04ba03ee tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.195509 Nov 28 06:49:09 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 208/631] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 06:49:08 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-interface => generated 283 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:49:09 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "tag": "e51be746-1419-4a95-8bc6-bcf4ed942927"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] Creating event network-changed:e51be746-1419-4a95-8bc6-bcf4ed942927 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:49:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e329e713-4882-40b3-9d04-d7a9bf18c60b req-ab2ff51f-4e32-48d9-8346-7b930cde5301 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112505 Nov 28 06:49:09 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 210/632] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:10 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-c7661650-53dc-487c-8380-b745cec6de6f tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3" status: 200 len: 1628 microversion: 2.49 time: 0.356899 Nov 28 06:49:10 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 215/633] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:49:10 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3 => generated 1628 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:49:10 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "602314ac-ba40-444e-ab59-79363f9eeecb", "tag": "nic-tag"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:10 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "tag": "f6b43f71-0053-4685-829d-52a0eda846b6"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] Creating event network-changed:f6b43f71-0053-4685-829d-52a0eda846b6 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:49:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-2bf554d6-3e98-44dc-8118-de136e11b2e6 req-8a4edc20-0990-490a-a33e-797d3dcc067b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047655 Nov 28 06:49:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 211/634] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:13 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "name": "network-vif-plugged", "status": "completed", "tag": "f6b43f71-0053-4685-829d-52a0eda846b6"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:13 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] Creating event network-vif-plugged:f6b43f71-0053-4685-829d-52a0eda846b6 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:49:13 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-63b93422-c1de-41c2-919f-380a5afc6844 req-c95cfc98-703e-4197-a0a9-9c33975ff5ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046519 Nov 28 06:49:13 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 216/635] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:13 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:14 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-4504c3c0-fee4-47bf-8c39-92ab63b40bdd tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "POST /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-interface" status: 200 len: 282 microversion: 2.49 time: 3.614681 Nov 28 06:49:14 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 209/636] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Nov 28 06:49:10 2023] POST /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-interface => generated 282 bytes in 3616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:49:14 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b", "tag": "volume-tag"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:14 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-a2eaf5c2-7e8c-448f-a6c9-f4b02f445a01 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "POST /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.327137 Nov 28 06:49:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 212/637] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 06:49:14 2023] POST /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:49:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "name": "network-vif-plugged", "status": "completed", "tag": "f6b43f71-0053-4685-829d-52a0eda846b6"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] Creating event network-vif-plugged:f6b43f71-0053-4685-829d-52a0eda846b6 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:49:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-0902bac6-5952-4f29-932f-e0f5a2093f12 req-02c8c78a-6947-4cd1-9d81-41f62464fe86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036045 Nov 28 06:49:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 217/638] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:22 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d1771bcf-3e2e-48c1-b659-622fd95bd675 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:22 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d1771bcf-3e2e-48c1-b659-622fd95bd675 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1771bcf-3e2e-48c1-b659-622fd95bd675 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1771bcf-3e2e-48c1-b659-622fd95bd675 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1771bcf-3e2e-48c1-b659-622fd95bd675 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1771bcf-3e2e-48c1-b659-622fd95bd675 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1771bcf-3e2e-48c1-b659-622fd95bd675 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d1771bcf-3e2e-48c1-b659-622fd95bd675 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:22 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d1771bcf-3e2e-48c1-b659-622fd95bd675 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:22 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d1771bcf-3e2e-48c1-b659-622fd95bd675 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa" status: 200 len: 1723 microversion: 2.1 time: 0.250144 Nov 28 06:49:22 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 210/639] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:49:22 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:27 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lazy-loading 'services' on Instance uuid 75046337-1afd-4458-a305-9922679ce7e3 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:49:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-b80d8338-27a2-4dfb-8906-e32b2877d79e tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-volume_attachments/ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b" status: 202 len: 0 microversion: 2.49 time: 0.200289 Nov 28 06:49:27 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 213/640] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 06:49:27 2023] DELETE /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-volume_attachments/ed66bc5a-a1d7-4ae9-8d58-92ce1acc7c2b => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:49:33 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:33 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:33 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-1ff42a01-22fa-425f-8b3e-f23ab8154281 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-1ff42a01-22fa-425f-8b3e-f23ab8154281 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=6,nova_cell1:INSERT=4,nova_cell1:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1ff42a01-22fa-425f-8b3e-f23ab8154281 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1ff42a01-22fa-425f-8b3e-f23ab8154281 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1ff42a01-22fa-425f-8b3e-f23ab8154281 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1ff42a01-22fa-425f-8b3e-f23ab8154281 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1ff42a01-22fa-425f-8b3e-f23ab8154281 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1ff42a01-22fa-425f-8b3e-f23ab8154281 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:33 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Going to try to start instance {{(pid=64872) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 28 06:49:33 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f94167ab-5d16-41ca-a3e4-37a7fccea11d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/action" status: 202 len: 0 microversion: 2.1 time: 0.270073 Nov 28 06:49:33 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 218/641] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:49:33 2023] POST /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:49:33 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-1ff42a01-22fa-425f-8b3e-f23ab8154281 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b878f5054743d690f01e77e7425371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55617103c9e348b3bc963810362acb6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-1ff42a01-22fa-425f-8b3e-f23ab8154281 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813" status: 200 len: 1562 microversion: 2.1 time: 0.215667 Nov 28 06:49:33 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 211/642] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:49:33 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813 => generated 1562 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:49:33 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9b7899c9-60cb-4c5c-82f0-add60b3e1fc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:33 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9b7899c9-60cb-4c5c-82f0-add60b3e1fc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9b7899c9-60cb-4c5c-82f0-add60b3e1fc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9b7899c9-60cb-4c5c-82f0-add60b3e1fc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9b7899c9-60cb-4c5c-82f0-add60b3e1fc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9b7899c9-60cb-4c5c-82f0-add60b3e1fc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9b7899c9-60cb-4c5c-82f0-add60b3e1fc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9b7899c9-60cb-4c5c-82f0-add60b3e1fc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:34 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-9b7899c9-60cb-4c5c-82f0-add60b3e1fc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9b7899c9-60cb-4c5c-82f0-add60b3e1fc6 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1695 microversion: 2.1 time: 0.244042 Nov 28 06:49:34 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 214/643] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:49:33 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1695 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:49:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-plugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] Creating event network-vif-plugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:49:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-28600a5c-82f1-44b5-8dc0-806aaf6b4ddf req-659db044-5f00-4997-95e8-82567b3ba055 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094277 Nov 28 06:49:38 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 219/644] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:40 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-plugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] Creating event network-vif-plugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:49:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-c2819dc4-d5cc-4f7b-b81a-609291a3e8fe req-3ad1af04-4b05-4f42-9f05-a7ecf5e9947b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031877 Nov 28 06:49:40 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 212/645] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:42 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-df876567-6491-4e3b-8e1f-5f489810fcfb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:42 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-df876567-6491-4e3b-8e1f-5f489810fcfb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df876567-6491-4e3b-8e1f-5f489810fcfb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df876567-6491-4e3b-8e1f-5f489810fcfb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df876567-6491-4e3b-8e1f-5f489810fcfb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df876567-6491-4e3b-8e1f-5f489810fcfb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df876567-6491-4e3b-8e1f-5f489810fcfb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-df876567-6491-4e3b-8e1f-5f489810fcfb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:42 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-df876567-6491-4e3b-8e1f-5f489810fcfb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:42 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-df876567-6491-4e3b-8e1f-5f489810fcfb tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" status: 200 len: 1543 microversion: 2.1 time: 0.245905 Nov 28 06:49:42 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 215/646] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:49:42 2023] GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db => generated 1543 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6732e8a2-cf7c-4320-92cd-e70fc56116d0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-6732e8a2-cf7c-4320-92cd-e70fc56116d0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6732e8a2-cf7c-4320-92cd-e70fc56116d0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6732e8a2-cf7c-4320-92cd-e70fc56116d0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6732e8a2-cf7c-4320-92cd-e70fc56116d0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6732e8a2-cf7c-4320-92cd-e70fc56116d0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6732e8a2-cf7c-4320-92cd-e70fc56116d0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6732e8a2-cf7c-4320-92cd-e70fc56116d0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:49 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-6732e8a2-cf7c-4320-92cd-e70fc56116d0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-6732e8a2-cf7c-4320-92cd-e70fc56116d0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a" status: 200 len: 1701 microversion: 2.1 time: 0.285899 Nov 28 06:49:49 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 220/647] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:49:49 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a => generated 1701 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:49:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:50 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-601cedfd-27bd-491f-9cdb-cf9a963368c5 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-interface/f6b43f71-0053-4685-829d-52a0eda846b6" status: 202 len: 0 microversion: 2.49 time: 0.100296 Nov 28 06:49:50 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 213/648] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Nov 28 06:49:50 2023] DELETE /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-interface/f6b43f71-0053-4685-829d-52a0eda846b6 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:49:50 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-f54f95af-b5de-406f-a41c-318e65968bb6 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:50 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-f54f95af-b5de-406f-a41c-318e65968bb6 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f54f95af-b5de-406f-a41c-318e65968bb6 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f54f95af-b5de-406f-a41c-318e65968bb6 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f54f95af-b5de-406f-a41c-318e65968bb6 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f54f95af-b5de-406f-a41c-318e65968bb6 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f54f95af-b5de-406f-a41c-318e65968bb6 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f54f95af-b5de-406f-a41c-318e65968bb6 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:50 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-f54f95af-b5de-406f-a41c-318e65968bb6 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-instance-actions/req-601cedfd-27bd-491f-9cdb-cf9a963368c5" status: 200 len: 474 microversion: 2.49 time: 0.369716 Nov 28 06:49:50 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 216/649] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 06:49:50 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-instance-actions/req-601cedfd-27bd-491f-9cdb-cf9a963368c5 => generated 474 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 28 06:49:50 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "name": "network-vif-unplugged", "status": "completed", "tag": "f6b43f71-0053-4685-829d-52a0eda846b6"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] Creating event network-vif-unplugged:f6b43f71-0053-4685-829d-52a0eda846b6 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:49:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-395dbc7e-13c1-45ce-b206-5372dd1ad6ac req-ad1584a2-457f-450a-9c85-7b072d3e472e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144062 Nov 28 06:49:50 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 221/650] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:49:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1304545091", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "f62a76e5-f00c-416b-84d0-db9b754396ab", "destination_type": "volume"}], "networks": [{"uuid": "7bc73412-fe34-4d8c-85c8-4cc726512d5e"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:52 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] validate_networks() for [('7bc73412-fe34-4d8c-85c8-4cc726512d5e', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:49:52 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "name": "network-vif-plugged", "status": "completed", "tag": "f6b43f71-0053-4685-829d-52a0eda846b6"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] Creating event network-vif-plugged:f6b43f71-0053-4685-829d-52a0eda846b6 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:49:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-1f6888ef-ff42-4d78-8756-3171543df0c7 req-8feca464-8504-486b-bafa-085b809642a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059877 Nov 28 06:49:52 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 217/651] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting quotas for project a07e9312175c4e73aa29a51865d61ebd. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Getting quotas for user c13b793a926942e88fc3416cf3fa005e and project a07e9312175c4e73aa29a51865d61ebd. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:49:53 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:49:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5e6dfcd1-d146-4cb6-9e5c-bab5991b96c3 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.703256 Nov 28 06:49:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 214/652] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 06:49:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 06:49:53 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1e996c63-c8fc-4ebe-bdb6-a34d3a132bf9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:49:53 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1e996c63-c8fc-4ebe-bdb6-a34d3a132bf9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:49:53 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1e996c63-c8fc-4ebe-bdb6-a34d3a132bf9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:53 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1e996c63-c8fc-4ebe-bdb6-a34d3a132bf9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:53 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1e996c63-c8fc-4ebe-bdb6-a34d3a132bf9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:49:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1e996c63-c8fc-4ebe-bdb6-a34d3a132bf9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895" status: 200 len: 1395 microversion: 2.87 time: 0.081409 Nov 28 06:49:53 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 222/653] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:49:53 2023] GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895 => generated 1395 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:49:56 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:49:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:49:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:49:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:49:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] Creating event network-changed:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:49:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-95fe865f-51c8-4bb3-b3aa-1e85a6db4b13 req-13364665-4d2c-45a7-8abc-b648925c67ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041145 Nov 28 06:49:56 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 218/654] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:49:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1539515390", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "45c733cf-4326-405a-9d99-92df8dc47b61"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] validate_networks() for [('45c733cf-4326-405a-9d99-92df8dc47b61', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Getting quotas for project d4386d41a22343b185f320b3f90d1a83. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Getting quotas for user 9a2c63a8fe9f4992b7ff2aa75a6c4b86 and project d4386d41a22343b185f320b3f90d1a83. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:50:01 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:50:01 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c93924aa-86db-4f60-a09c-ff17cb1badaa tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.479808 Nov 28 06:50:01 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 215/655] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:50:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:50:01 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7ed37374-3faa-4238-b1c3-cbb8063245b7 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:01 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7ed37374-3faa-4238-b1c3-cbb8063245b7 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:01 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=8 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:01 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-7ed37374-3faa-4238-b1c3-cbb8063245b7 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2c63a8fe9f4992b7ff2aa75a6c4b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4386d41a22343b185f320b3f90d1a83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:01 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7ed37374-3faa-4238-b1c3-cbb8063245b7 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" status: 200 len: 1206 microversion: 2.1 time: 0.065309 Nov 28 06:50:01 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 223/656] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:50:01 2023] GET /compute/v2.1/servers/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 => generated 1206 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:50:03 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d8e79ed3-4cbc-4a74-9e99-0bc4a83d1ef8 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:03 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d8e79ed3-4cbc-4a74-9e99-0bc4a83d1ef8 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8e79ed3-4cbc-4a74-9e99-0bc4a83d1ef8 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8e79ed3-4cbc-4a74-9e99-0bc4a83d1ef8 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8e79ed3-4cbc-4a74-9e99-0bc4a83d1ef8 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8e79ed3-4cbc-4a74-9e99-0bc4a83d1ef8 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8e79ed3-4cbc-4a74-9e99-0bc4a83d1ef8 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8e79ed3-4cbc-4a74-9e99-0bc4a83d1ef8 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:03 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d8e79ed3-4cbc-4a74-9e99-0bc4a83d1ef8 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.289887 Nov 28 06:50:03 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 219/657] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 06:50:03 2023] GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f/os-interface => generated 1829 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6", "tag": "632eb6d0-1687-4fac-a60d-f919d2ea0941"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] Creating event network-changed:632eb6d0-1687-4fac-a60d-f919d2ea0941 for instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 on user Nov 28 06:50:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-feccd5c9-8457-4c43-9c62-5294b30cbc47 req-0dcf10b1-5d68-46ab-95e8-87d3566ca5a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042664 Nov 28 06:50:04 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 216/658] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "tag": "ce346bd0-6d5d-45d0-9165-4da3207ce081"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] Creating event network-changed:ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-16f9ad16-4bbb-4e64-85a0-a88328658a41 req-595e2c87-5b9a-41c5-87fc-bf427459c74f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040513 Nov 28 06:50:04 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 224/659] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:04 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6e8486ae-773c-4488-ab93-39febfc7201b tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f" status: 200 len: 2827 microversion: 2.42 time: 0.305684 Nov 28 06:50:04 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 220/660] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:50:04 2023] GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f => generated 2827 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f9b7c9bf-d319-4dcf-81fd-e96f9f7ff84f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f9b7c9bf-d319-4dcf-81fd-e96f9f7ff84f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9b7c9bf-d319-4dcf-81fd-e96f9f7ff84f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9b7c9bf-d319-4dcf-81fd-e96f9f7ff84f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9b7c9bf-d319-4dcf-81fd-e96f9f7ff84f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9b7c9bf-d319-4dcf-81fd-e96f9f7ff84f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9b7c9bf-d319-4dcf-81fd-e96f9f7ff84f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9b7c9bf-d319-4dcf-81fd-e96f9f7ff84f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:05 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f9b7c9bf-d319-4dcf-81fd-e96f9f7ff84f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.638421 Nov 28 06:50:05 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 217/661] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 06:50:04 2023] GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f/os-interface => generated 1829 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 06:50:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6", "name": "network-vif-plugged", "status": "completed", "tag": "632eb6d0-1687-4fac-a60d-f919d2ea0941"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] Creating event network-vif-plugged:632eb6d0-1687-4fac-a60d-f919d2ea0941 for instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 on user Nov 28 06:50:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-219018c9-80e9-4f8e-a105-5268bcf6751c req-b788336e-fe04-4760-b2c7-c30403e1871d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052326 Nov 28 06:50:06 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 225/662] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:06 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:06 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:06 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:50:07 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1aaa8a6e-1219-43e7-a1df-81f4c060cf22 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f" status: 204 len: 0 microversion: 2.42 time: 0.121567 Nov 28 06:50:07 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 221/663] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:50:06 2023] DELETE /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:07 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-unplugged", "status": "completed", "tag": "ce346bd0-6d5d-45d0-9165-4da3207ce081"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:07 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] Creating event network-vif-unplugged:ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:07 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-00aa538d-9a83-4338-b665-c978e16fda33 req-76dbcedf-8e5e-4d60-ad7f-eef8b6c1be45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.282651 Nov 28 06:50:07 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 226/664] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:07 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59abab1396dc462cab4cd9c945c446f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24232ad48c7c4b6c94efc23f0682247f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:07 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c1802f45-c95e-4550-8371-2f2ade4c4b9f tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f" status: 200 len: 2951 microversion: 2.42 time: 0.654542 Nov 28 06:50:07 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 218/665] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:50:07 2023] GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f => generated 2951 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:50:07 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-unplugged", "status": "completed", "tag": "0314f996-11e4-4335-8088-c85a9ec88931"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:07 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] Creating event network-vif-unplugged:0314f996-11e4-4335-8088-c85a9ec88931 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:07 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-80d48ff4-66f6-4089-96ec-476a48e399df req-cbdd4eeb-f6e1-4c48-84ff-1ad52b493199 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039665 Nov 28 06:50:07 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 222/666] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6", "name": "network-vif-plugged", "status": "completed", "tag": "632eb6d0-1687-4fac-a60d-f919d2ea0941"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-unplugged", "status": "completed", "tag": "7a5dfb04-4a6f-4704-9885-d38d223aeae6"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "7a5dfb04-4a6f-4704-9885-d38d223aeae6"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-unplugged", "status": "completed", "tag": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Creating event network-vif-plugged:632eb6d0-1687-4fac-a60d-f919d2ea0941 for instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 on user Nov 28 06:50:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Creating event network-vif-unplugged:7a5dfb04-4a6f-4704-9885-d38d223aeae6 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Creating event network-vif-plugged:7a5dfb04-4a6f-4704-9885-d38d223aeae6 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] Creating event network-vif-unplugged:c1a310b8-79bf-4098-a7f8-0f1736c5dd79 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-66ed30a3-d420-481f-b551-909b26350ba2 req-93f33ef8-cfa7-41c2-83d6-5950612ad8f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.039670 Nov 28 06:50:08 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 227/667] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:08 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:50:09 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "ce346bd0-6d5d-45d0-9165-4da3207ce081"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-unplugged", "status": "completed", "tag": "57870541-c5b7-4cd3-9836-64b4ee4ffb81"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "57870541-c5b7-4cd3-9836-64b4ee4ffb81"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-unplugged", "status": "completed", "tag": "40d74d10-744b-4187-8a27-c72bfc4b1a47"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "40d74d10-744b-4187-8a27-c72bfc4b1a47"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Creating event network-vif-plugged:ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Creating event network-vif-unplugged:57870541-c5b7-4cd3-9836-64b4ee4ffb81 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Creating event network-vif-plugged:57870541-c5b7-4cd3-9836-64b4ee4ffb81 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Creating event network-vif-unplugged:40d74d10-744b-4187-8a27-c72bfc4b1a47 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] Creating event network-vif-plugged:40d74d10-744b-4187-8a27-c72bfc4b1a47 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-a2597ee8-99f4-419b-8957-dd449f6166c6 req-cb775312-e82e-4bda-b7c2-f50c8dc91a7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.036500 Nov 28 06:50:09 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 219/668] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:09 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:09 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "0314f996-11e4-4335-8088-c85a9ec88931"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-unplugged", "status": "completed", "tag": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Creating event network-vif-plugged:0314f996-11e4-4335-8088-c85a9ec88931 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Creating event network-vif-unplugged:8ab023f9-1a91-43d1-a020-8ecd1a6eafaf for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] Creating event network-vif-plugged:8ab023f9-1a91-43d1-a020-8ecd1a6eafaf for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-ef5650c0-020b-4f61-a40a-2eee2a27776c req-44adabf7-fea4-4e7b-9cb0-9fbec02e4a29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.056644 Nov 28 06:50:09 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 223/669] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:09 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:10 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-plugged", "status": "completed", "tag": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] Creating event network-vif-plugged:c1a310b8-79bf-4098-a7f8-0f1736c5dd79 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-837ba145-0c7a-44f9-9889-adbb4a896641 req-884ff746-6a54-40dd-967d-c04eb78761fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033055 Nov 28 06:50:10 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 228/670] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:11 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:11 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=12 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:11 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-df6bc22b-9873-4579-99fd-102b0c2e7bfe req-1d56878f-16d9-4e71-b264-ca36bfd6c32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "name": "network-vif-deleted", "tag": "f6b43f71-0053-4685-829d-52a0eda846b6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-df6bc22b-9873-4579-99fd-102b0c2e7bfe req-1d56878f-16d9-4e71-b264-ca36bfd6c32f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-df6bc22b-9873-4579-99fd-102b0c2e7bfe req-1d56878f-16d9-4e71-b264-ca36bfd6c32f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-df6bc22b-9873-4579-99fd-102b0c2e7bfe req-1d56878f-16d9-4e71-b264-ca36bfd6c32f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:11 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-df6bc22b-9873-4579-99fd-102b0c2e7bfe req-1d56878f-16d9-4e71-b264-ca36bfd6c32f service nova] Creating event network-vif-deleted:f6b43f71-0053-4685-829d-52a0eda846b6 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:50:11 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-df6bc22b-9873-4579-99fd-102b0c2e7bfe req-1d56878f-16d9-4e71-b264-ca36bfd6c32f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036201 Nov 28 06:50:11 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 220/671] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:50:13 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:13 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:50:13 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-b829071f-43aa-4033-8f53-cdd2b600e9a1 req-b744485d-8c61-4542-a67b-be4d663a810c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060031 Nov 28 06:50:13 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 224/672] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:14 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-eba9f807-0d0c-4ad8-9a2d-f963a8bb2de6 req-8fa9c375-1f8d-41a7-96da-bf395b565713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-deleted", "tag": "40d74d10-744b-4187-8a27-c72bfc4b1a47"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-eba9f807-0d0c-4ad8-9a2d-f963a8bb2de6 req-8fa9c375-1f8d-41a7-96da-bf395b565713 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-eba9f807-0d0c-4ad8-9a2d-f963a8bb2de6 req-8fa9c375-1f8d-41a7-96da-bf395b565713 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-eba9f807-0d0c-4ad8-9a2d-f963a8bb2de6 req-8fa9c375-1f8d-41a7-96da-bf395b565713 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-eba9f807-0d0c-4ad8-9a2d-f963a8bb2de6 req-8fa9c375-1f8d-41a7-96da-bf395b565713 service nova] Creating event network-vif-deleted:40d74d10-744b-4187-8a27-c72bfc4b1a47 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-eba9f807-0d0c-4ad8-9a2d-f963a8bb2de6 req-8fa9c375-1f8d-41a7-96da-bf395b565713 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048053 Nov 28 06:50:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 229/673] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:50:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-e0091753-6e4f-4ff1-9864-cfeaeba07f85 req-67f9c19c-b31a-46e5-a18a-34e432679014 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037839 Nov 28 06:50:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 221/674] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-deleted", "tag": "8ab023f9-1a91-43d1-a020-8ecd1a6eafaf"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-deleted", "tag": "c1a310b8-79bf-4098-a7f8-0f1736c5dd79"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-deleted", "tag": "ce346bd0-6d5d-45d0-9165-4da3207ce081"}, {"server_uuid": "c7a2db07-1739-4fa5-b444-86d602ca586f", "name": "network-vif-deleted", "tag": "0314f996-11e4-4335-8088-c85a9ec88931"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] Creating event network-vif-deleted:8ab023f9-1a91-43d1-a020-8ecd1a6eafaf for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] Creating event network-vif-deleted:c1a310b8-79bf-4098-a7f8-0f1736c5dd79 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] Creating event network-vif-deleted:ce346bd0-6d5d-45d0-9165-4da3207ce081 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] Creating event network-vif-deleted:0314f996-11e4-4335-8088-c85a9ec88931 for instance c7a2db07-1739-4fa5-b444-86d602ca586f on user Nov 28 06:50:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-1d347931-a3fa-41f7-8e94-02192add5eae req-5cd64577-6026-4804-9dc7-acdf327c02b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.041003 Nov 28 06:50:16 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 225/675] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7ffd5752-a43c-44c3-87cf-db4c64d797f1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:22 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7ffd5752-a43c-44c3-87cf-db4c64d797f1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7ffd5752-a43c-44c3-87cf-db4c64d797f1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7ffd5752-a43c-44c3-87cf-db4c64d797f1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7ffd5752-a43c-44c3-87cf-db4c64d797f1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7ffd5752-a43c-44c3-87cf-db4c64d797f1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7ffd5752-a43c-44c3-87cf-db4c64d797f1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7ffd5752-a43c-44c3-87cf-db4c64d797f1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:22 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-7ffd5752-a43c-44c3-87cf-db4c64d797f1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7ffd5752-a43c-44c3-87cf-db4c64d797f1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa" status: 200 len: 1723 microversion: 2.1 time: 0.319614 Nov 28 06:50:22 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 230/676] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:50:22 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:50:23 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-cbb742b9-491e-4365-9344-cc5a31dd29bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:23 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-cbb742b9-491e-4365-9344-cc5a31dd29bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cbb742b9-491e-4365-9344-cc5a31dd29bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cbb742b9-491e-4365-9344-cc5a31dd29bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cbb742b9-491e-4365-9344-cc5a31dd29bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cbb742b9-491e-4365-9344-cc5a31dd29bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cbb742b9-491e-4365-9344-cc5a31dd29bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cbb742b9-491e-4365-9344-cc5a31dd29bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:23 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-cbb742b9-491e-4365-9344-cc5a31dd29bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-cbb742b9-491e-4365-9344-cc5a31dd29bc tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1658 microversion: 2.1 time: 0.229283 Nov 28 06:50:23 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 222/677] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:50:23 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1658 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:50:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-a2795beb-3bd7-4702-a8b2-cea7e1d5710a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:24 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-a2795beb-3bd7-4702-a8b2-cea7e1d5710a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2795beb-3bd7-4702-a8b2-cea7e1d5710a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2795beb-3bd7-4702-a8b2-cea7e1d5710a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2795beb-3bd7-4702-a8b2-cea7e1d5710a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2795beb-3bd7-4702-a8b2-cea7e1d5710a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2795beb-3bd7-4702-a8b2-cea7e1d5710a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a2795beb-3bd7-4702-a8b2-cea7e1d5710a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:24 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-a2795beb-3bd7-4702-a8b2-cea7e1d5710a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-a2795beb-3bd7-4702-a8b2-cea7e1d5710a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1699 microversion: 2.1 time: 0.246767 Nov 28 06:50:24 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 226/678] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:50:24 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1699 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:50:34 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-0126dde7-1ad3-4304-8390-2f0027665686 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:34 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-0126dde7-1ad3-4304-8390-2f0027665686 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:34 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=28 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:34 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=18 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0126dde7-1ad3-4304-8390-2f0027665686 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0126dde7-1ad3-4304-8390-2f0027665686 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0126dde7-1ad3-4304-8390-2f0027665686 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0126dde7-1ad3-4304-8390-2f0027665686 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0126dde7-1ad3-4304-8390-2f0027665686 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0126dde7-1ad3-4304-8390-2f0027665686 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-0126dde7-1ad3-4304-8390-2f0027665686 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.160074 Nov 28 06:50:34 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 231/679] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:50:34 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-interface => generated 282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:34 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab422771-7c11-4074-b4a6-d793c790e813", "tag": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:34 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:34 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:34 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] Creating event network-changed:5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance ab422771-7c11-4074-b4a6-d793c790e813 on user Nov 28 06:50:34 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-2bd0366b-8800-4f6e-8080-c86ef7fc9eb7 req-8d86cc1a-d63b-4c31-a127-7e98085eae5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038915 Nov 28 06:50:34 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 223/680] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6ec547cd-88b6-43a4-bb19-9799e940cc66 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6ec547cd-88b6-43a4-bb19-9799e940cc66 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ec547cd-88b6-43a4-bb19-9799e940cc66 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ec547cd-88b6-43a4-bb19-9799e940cc66 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ec547cd-88b6-43a4-bb19-9799e940cc66 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ec547cd-88b6-43a4-bb19-9799e940cc66 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ec547cd-88b6-43a4-bb19-9799e940cc66 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ec547cd-88b6-43a4-bb19-9799e940cc66 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:35 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-6ec547cd-88b6-43a4-bb19-9799e940cc66 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b878f5054743d690f01e77e7425371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55617103c9e348b3bc963810362acb6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:35 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6ec547cd-88b6-43a4-bb19-9799e940cc66 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813" status: 200 len: 1562 microversion: 2.1 time: 0.268997 Nov 28 06:50:35 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 227/681] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:50:35 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813 => generated 1562 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:50:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:35 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b1b878f5054743d690f01e77e7425371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55617103c9e348b3bc963810362acb6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:35 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Searching by: {'deleted': False, 'project_id': '55617103c9e348b3bc963810362acb6b'} {{(pid=64872) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 06:50:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:35 user devstack@n-api.service[64872]: DEBUG nova.compute.multi_cell_list [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 06:50:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-723e2999-f883-4920-adac-9677b7882eff tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 350 microversion: 2.1 time: 0.237134 Nov 28 06:50:35 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 232/682] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 06:50:35 2023] GET /compute/v2.1/servers => generated 350 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:35 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "099bd1dc-45f7-4f2f-9e1f-f47124112712"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:35 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:35 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-46d1b1f9-6aab-4444-9535-dbcef97be078 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284685 Nov 28 06:50:35 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 224/683] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:50:35 2023] POST /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:40 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b6cbffeb-d18d-47d0-813e-a1c582190993 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:40 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-b6cbffeb-d18d-47d0-813e-a1c582190993 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6cbffeb-d18d-47d0-813e-a1c582190993 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6cbffeb-d18d-47d0-813e-a1c582190993 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6cbffeb-d18d-47d0-813e-a1c582190993 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6cbffeb-d18d-47d0-813e-a1c582190993 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6cbffeb-d18d-47d0-813e-a1c582190993 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b6cbffeb-d18d-47d0-813e-a1c582190993 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-b6cbffeb-d18d-47d0-813e-a1c582190993 tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-instance-actions/req-601cedfd-27bd-491f-9cdb-cf9a963368c5" status: 200 len: 503 microversion: 2.49 time: 0.057189 Nov 28 06:50:40 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 228/684] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 06:50:40 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-instance-actions/req-601cedfd-27bd-491f-9cdb-cf9a963368c5 => generated 503 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:50:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-49f58dac-8e13-41a8-ad1d-7d447f3adcfb tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:40 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-49f58dac-8e13-41a8-ad1d-7d447f3adcfb tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49f58dac-8e13-41a8-ad1d-7d447f3adcfb tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49f58dac-8e13-41a8-ad1d-7d447f3adcfb tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49f58dac-8e13-41a8-ad1d-7d447f3adcfb tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49f58dac-8e13-41a8-ad1d-7d447f3adcfb tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49f58dac-8e13-41a8-ad1d-7d447f3adcfb tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49f58dac-8e13-41a8-ad1d-7d447f3adcfb tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-49f58dac-8e13-41a8-ad1d-7d447f3adcfb tempest-TaggedAttachmentsTest-922165659 tempest-TaggedAttachmentsTest-922165659-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-instance-actions/req-601cedfd-27bd-491f-9cdb-cf9a963368c5" status: 200 len: 503 microversion: 2.49 time: 0.106712 Nov 28 06:50:40 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 233/685] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 06:50:40 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-instance-actions/req-601cedfd-27bd-491f-9cdb-cf9a963368c5 => generated 503 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:50:40 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-def8a40d-9f0c-4519-b957-9234359a67ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:40 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-def8a40d-9f0c-4519-b957-9234359a67ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-def8a40d-9f0c-4519-b957-9234359a67ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-def8a40d-9f0c-4519-b957-9234359a67ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-def8a40d-9f0c-4519-b957-9234359a67ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-def8a40d-9f0c-4519-b957-9234359a67ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-def8a40d-9f0c-4519-b957-9234359a67ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-def8a40d-9f0c-4519-b957-9234359a67ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-def8a40d-9f0c-4519-b957-9234359a67ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.054878 Nov 28 06:50:40 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 225/686] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 06:50:40 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:50:41 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:41 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:41 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:50:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d12de5e5-2220-4bfb-8162-20b9fdf6a4a3 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3" status: 204 len: 0 microversion: 2.49 time: 0.393224 Nov 28 06:50:41 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 229/687] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:50:41 2023] DELETE /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:41 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dde6b091a2134b83806602165f723ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898c9652da6145af82836b639c44458d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:41 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-762c10db-0241-43e2-8135-c59fa8941c70 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3" status: 200 len: 1753 microversion: 2.49 time: 0.313332 Nov 28 06:50:41 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 234/688] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:50:41 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3 => generated 1753 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:50:41 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "name": "network-vif-unplugged", "status": "completed", "tag": "e51be746-1419-4a95-8bc6-bcf4ed942927"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] Creating event network-vif-unplugged:e51be746-1419-4a95-8bc6-bcf4ed942927 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:50:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-ed8c228a-0e4f-4c9c-aa50-6c4489844d05 req-e3faa8ee-4497-45bf-ba0d-fc785f003b6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058567 Nov 28 06:50:41 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 226/689] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:42 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-261764fa-95ae-48b5-8a47-9af863df2638 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:42 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-261764fa-95ae-48b5-8a47-9af863df2638 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-261764fa-95ae-48b5-8a47-9af863df2638 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-261764fa-95ae-48b5-8a47-9af863df2638 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-261764fa-95ae-48b5-8a47-9af863df2638 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-261764fa-95ae-48b5-8a47-9af863df2638 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-261764fa-95ae-48b5-8a47-9af863df2638 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-261764fa-95ae-48b5-8a47-9af863df2638 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:42 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-261764fa-95ae-48b5-8a47-9af863df2638 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.144373 Nov 28 06:50:42 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 230/690] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:50:42 2023] GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/os-interface => generated 282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-5cff9652-bc7c-4f5b-8d12-fc3aec12c777 req-9d4ac2b1-14f8-4d50-ade3-1662b820d27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "name": "network-vif-deleted", "tag": "e51be746-1419-4a95-8bc6-bcf4ed942927"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-5cff9652-bc7c-4f5b-8d12-fc3aec12c777 req-9d4ac2b1-14f8-4d50-ade3-1662b820d27c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-5cff9652-bc7c-4f5b-8d12-fc3aec12c777 req-9d4ac2b1-14f8-4d50-ade3-1662b820d27c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-5cff9652-bc7c-4f5b-8d12-fc3aec12c777 req-9d4ac2b1-14f8-4d50-ade3-1662b820d27c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-5cff9652-bc7c-4f5b-8d12-fc3aec12c777 req-9d4ac2b1-14f8-4d50-ade3-1662b820d27c service nova] Creating event network-vif-deleted:e51be746-1419-4a95-8bc6-bcf4ed942927 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:50:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-5cff9652-bc7c-4f5b-8d12-fc3aec12c777 req-9d4ac2b1-14f8-4d50-ade3-1662b820d27c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039808 Nov 28 06:50:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 235/691] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-2460a7ea-7ea8-4c1c-a442-4d37626fd63c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895" status: 200 len: 1769 microversion: 2.87 time: 0.307975 Nov 28 06:50:43 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 227/692] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:50:43 2023] GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895 => generated 1769 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:50:43 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db", "tag": "b7c5e041-ed7b-4c47-96b6-dbebd8356786"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] Creating event network-changed:b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db on user Nov 28 06:50:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-748ccbbe-bea2-4257-b21a-56f4a9a7944f req-67e232b9-22d9-4bfe-aa80-4fe835c745a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028606 Nov 28 06:50:43 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 231/693] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1d020861-45b1-47fa-aacd-6268e5d49db4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1d020861-45b1-47fa-aacd-6268e5d49db4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d020861-45b1-47fa-aacd-6268e5d49db4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d020861-45b1-47fa-aacd-6268e5d49db4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d020861-45b1-47fa-aacd-6268e5d49db4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d020861-45b1-47fa-aacd-6268e5d49db4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d020861-45b1-47fa-aacd-6268e5d49db4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1d020861-45b1-47fa-aacd-6268e5d49db4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75046337-1afd-4458-a305-9922679ce7e3", "name": "network-vif-plugged", "status": "completed", "tag": "e51be746-1419-4a95-8bc6-bcf4ed942927"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1d020861-45b1-47fa-aacd-6268e5d49db4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/ips" status: 200 len: 108 microversion: 2.1 time: 0.059047 Nov 28 06:50:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 236/694] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:50:43 2023] GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/ips => generated 108 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] Creating event network-vif-plugged:e51be746-1419-4a95-8bc6-bcf4ed942927 for instance 75046337-1afd-4458-a305-9922679ce7e3 on user Nov 28 06:50:44 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-1f8dee7f-3c8e-4133-ba87-fa8e923e33fa req-43ef3f24-c0d8-4a26-9219-b2ad524167d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031423 Nov 28 06:50:44 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 228/695] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:46 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "742921c3-d954-4a45-a388-876267a6379d"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:46 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9edc6fe0-dd7d-4253-a50c-28fd55e496d4 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383948 Nov 28 06:50:46 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 232/696] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:50:46 2023] POST /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-129f2762-faa4-4c0e-96c5-7202ad1a918b req-9ca8de64-e159-45d5-abb8-20c8e3c94bc2 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG nova.compute.api [req-129f2762-faa4-4c0e-96c5-7202ad1a918b req-9ca8de64-e159-45d5-abb8-20c8e3c94bc2 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-129f2762-faa4-4c0e-96c5-7202ad1a918b req-9ca8de64-e159-45d5-abb8-20c8e3c94bc2 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-129f2762-faa4-4c0e-96c5-7202ad1a918b req-9ca8de64-e159-45d5-abb8-20c8e3c94bc2 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-129f2762-faa4-4c0e-96c5-7202ad1a918b req-9ca8de64-e159-45d5-abb8-20c8e3c94bc2 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-129f2762-faa4-4c0e-96c5-7202ad1a918b req-9ca8de64-e159-45d5-abb8-20c8e3c94bc2 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-129f2762-faa4-4c0e-96c5-7202ad1a918b req-9ca8de64-e159-45d5-abb8-20c8e3c94bc2 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-129f2762-faa4-4c0e-96c5-7202ad1a918b req-9ca8de64-e159-45d5-abb8-20c8e3c94bc2 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-129f2762-faa4-4c0e-96c5-7202ad1a918b req-9ca8de64-e159-45d5-abb8-20c8e3c94bc2 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712" status: 200 len: 302 microversion: 2.89 time: 0.152562 Nov 28 06:50:49 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 237/697] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 06:50:49 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-5b80227f-c9c3-498c-91e6-ebc60814704d req-23ada660-8924-45cc-87af-3732be52369f tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG nova.compute.api [req-5b80227f-c9c3-498c-91e6-ebc60814704d req-23ada660-8924-45cc-87af-3732be52369f tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5b80227f-c9c3-498c-91e6-ebc60814704d req-23ada660-8924-45cc-87af-3732be52369f tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5b80227f-c9c3-498c-91e6-ebc60814704d req-23ada660-8924-45cc-87af-3732be52369f tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5b80227f-c9c3-498c-91e6-ebc60814704d req-23ada660-8924-45cc-87af-3732be52369f tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5b80227f-c9c3-498c-91e6-ebc60814704d req-23ada660-8924-45cc-87af-3732be52369f tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5b80227f-c9c3-498c-91e6-ebc60814704d req-23ada660-8924-45cc-87af-3732be52369f tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5b80227f-c9c3-498c-91e6-ebc60814704d req-23ada660-8924-45cc-87af-3732be52369f tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-5b80227f-c9c3-498c-91e6-ebc60814704d req-23ada660-8924-45cc-87af-3732be52369f tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712" status: 200 len: 302 microversion: 2.89 time: 0.092755 Nov 28 06:50:49 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 229/698] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 06:50:49 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712 => generated 302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-11fc7c31-17f0-4137-b401-93e35a20064a req-787497db-ae10-4925-ba63-0c6f0cc50e59 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG nova.compute.api [req-11fc7c31-17f0-4137-b401-93e35a20064a req-787497db-ae10-4925-ba63-0c6f0cc50e59 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-11fc7c31-17f0-4137-b401-93e35a20064a req-787497db-ae10-4925-ba63-0c6f0cc50e59 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-11fc7c31-17f0-4137-b401-93e35a20064a req-787497db-ae10-4925-ba63-0c6f0cc50e59 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-11fc7c31-17f0-4137-b401-93e35a20064a req-787497db-ae10-4925-ba63-0c6f0cc50e59 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-11fc7c31-17f0-4137-b401-93e35a20064a req-787497db-ae10-4925-ba63-0c6f0cc50e59 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-11fc7c31-17f0-4137-b401-93e35a20064a req-787497db-ae10-4925-ba63-0c6f0cc50e59 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-11fc7c31-17f0-4137-b401-93e35a20064a req-787497db-ae10-4925-ba63-0c6f0cc50e59 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-11fc7c31-17f0-4137-b401-93e35a20064a req-787497db-ae10-4925-ba63-0c6f0cc50e59 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712" status: 200 len: 302 microversion: 2.89 time: 0.095669 Nov 28 06:50:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 233/699] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 06:50:49 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712 => generated 302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:50:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] HTTP exception thrown: Cannot 'detach_volume' instance de112cbb-849e-43c1-961a-4457585f2e9a while it is in vm_state rescued Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Returning 409 to user: Cannot 'detach_volume' instance de112cbb-849e-43c1-961a-4457585f2e9a while it is in vm_state rescued {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:50:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-bd2eccb0-3fa0-420a-8bf1-6f3290ffeb02 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-volume_attachments/daa2eb88-295a-4c93-81a0-3f799e732e97" status: 409 len: 152 microversion: 2.1 time: 0.114462 Nov 28 06:50:49 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 238/700] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:50:49 2023] DELETE /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-volume_attachments/daa2eb88-295a-4c93-81a0-3f799e732e97 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ca317881-3417-4905-8a2d-73d6e9487cda tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/action" status: 202 len: 0 microversion: 2.1 time: 0.079884 Nov 28 06:50:49 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 230/701] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:50:49 2023] POST /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f4dffa9a-0375-4d61-be2f-7f1f04c367e0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f4dffa9a-0375-4d61-be2f-7f1f04c367e0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4dffa9a-0375-4d61-be2f-7f1f04c367e0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4dffa9a-0375-4d61-be2f-7f1f04c367e0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4dffa9a-0375-4d61-be2f-7f1f04c367e0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4dffa9a-0375-4d61-be2f-7f1f04c367e0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4dffa9a-0375-4d61-be2f-7f1f04c367e0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4dffa9a-0375-4d61-be2f-7f1f04c367e0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e93827f0-1da2-45df-bf4f-8782de2d9b5f req-b2a9b68f-999b-4da8-97ed-e12e47d376fa tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG nova.compute.api [req-e93827f0-1da2-45df-bf4f-8782de2d9b5f req-b2a9b68f-999b-4da8-97ed-e12e47d376fa tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e93827f0-1da2-45df-bf4f-8782de2d9b5f req-b2a9b68f-999b-4da8-97ed-e12e47d376fa tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e93827f0-1da2-45df-bf4f-8782de2d9b5f req-b2a9b68f-999b-4da8-97ed-e12e47d376fa tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e93827f0-1da2-45df-bf4f-8782de2d9b5f req-b2a9b68f-999b-4da8-97ed-e12e47d376fa tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e93827f0-1da2-45df-bf4f-8782de2d9b5f req-b2a9b68f-999b-4da8-97ed-e12e47d376fa tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e93827f0-1da2-45df-bf4f-8782de2d9b5f req-b2a9b68f-999b-4da8-97ed-e12e47d376fa tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e93827f0-1da2-45df-bf4f-8782de2d9b5f req-b2a9b68f-999b-4da8-97ed-e12e47d376fa tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e93827f0-1da2-45df-bf4f-8782de2d9b5f req-b2a9b68f-999b-4da8-97ed-e12e47d376fa tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712" status: 200 len: 302 microversion: 2.89 time: 0.114226 Nov 28 06:50:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 234/702] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 06:50:49 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712 => generated 302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:50:50 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-f4dffa9a-0375-4d61-be2f-7f1f04c367e0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f4dffa9a-0375-4d61-be2f-7f1f04c367e0 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a" status: 200 len: 1709 microversion: 2.1 time: 0.254442 Nov 28 06:50:50 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 239/703] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:50:49 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a => generated 1709 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:50:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-dd757e7f-b911-4be1-ac9c-d0610c9b5c33 req-1a6c9844-b728-4652-9b9c-d48bc152a08c tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:50 user devstack@n-api.service[64871]: DEBUG nova.compute.api [req-dd757e7f-b911-4be1-ac9c-d0610c9b5c33 req-1a6c9844-b728-4652-9b9c-d48bc152a08c tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dd757e7f-b911-4be1-ac9c-d0610c9b5c33 req-1a6c9844-b728-4652-9b9c-d48bc152a08c tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dd757e7f-b911-4be1-ac9c-d0610c9b5c33 req-1a6c9844-b728-4652-9b9c-d48bc152a08c tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dd757e7f-b911-4be1-ac9c-d0610c9b5c33 req-1a6c9844-b728-4652-9b9c-d48bc152a08c tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dd757e7f-b911-4be1-ac9c-d0610c9b5c33 req-1a6c9844-b728-4652-9b9c-d48bc152a08c tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dd757e7f-b911-4be1-ac9c-d0610c9b5c33 req-1a6c9844-b728-4652-9b9c-d48bc152a08c tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dd757e7f-b911-4be1-ac9c-d0610c9b5c33 req-1a6c9844-b728-4652-9b9c-d48bc152a08c tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-dd757e7f-b911-4be1-ac9c-d0610c9b5c33 req-1a6c9844-b728-4652-9b9c-d48bc152a08c tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712" status: 200 len: 302 microversion: 2.89 time: 0.085459 Nov 28 06:50:50 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 231/704] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 06:50:50 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712 => generated 302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:50:50 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-a2a1a618-6e0c-4b2e-839a-3bc389503df3 req-3db1cf0c-4835-4104-9418-62566cbae053 tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:50 user devstack@n-api.service[64873]: DEBUG nova.compute.api [req-a2a1a618-6e0c-4b2e-839a-3bc389503df3 req-3db1cf0c-4835-4104-9418-62566cbae053 tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a2a1a618-6e0c-4b2e-839a-3bc389503df3 req-3db1cf0c-4835-4104-9418-62566cbae053 tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a2a1a618-6e0c-4b2e-839a-3bc389503df3 req-3db1cf0c-4835-4104-9418-62566cbae053 tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a2a1a618-6e0c-4b2e-839a-3bc389503df3 req-3db1cf0c-4835-4104-9418-62566cbae053 tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a2a1a618-6e0c-4b2e-839a-3bc389503df3 req-3db1cf0c-4835-4104-9418-62566cbae053 tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a2a1a618-6e0c-4b2e-839a-3bc389503df3 req-3db1cf0c-4835-4104-9418-62566cbae053 tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a2a1a618-6e0c-4b2e-839a-3bc389503df3 req-3db1cf0c-4835-4104-9418-62566cbae053 tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:50 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-a2a1a618-6e0c-4b2e-839a-3bc389503df3 req-3db1cf0c-4835-4104-9418-62566cbae053 tempest-TestServerVolumeAttachmentScenario-1411331673 tempest-TestServerVolumeAttachmentScenario-1411331673-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712" status: 200 len: 302 microversion: 2.89 time: 0.134023 Nov 28 06:50:50 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 235/705] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 06:50:50 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:50:51 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-unplugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:51 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36d2fb26-6898-433b-8c8e-7818cf21bd13"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:51 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:51 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:51 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] Creating event network-vif-unplugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:50:51 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-31226e56-71b5-4358-aa63-1f1845df051a req-5bbbce0f-1b72-4a56-bfb6-851aa77d9749 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033408 Nov 28 06:50:51 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 240/706] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:51 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-1f290557-56d2-4e54-b48a-1af770626351 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330175 Nov 28 06:50:51 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 232/707] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:50:51 2023] POST /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:51 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-71abd7f4-bf84-4561-adc1-a86e96ec511f tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:51 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-71abd7f4-bf84-4561-adc1-a86e96ec511f tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-71abd7f4-bf84-4561-adc1-a86e96ec511f tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-71abd7f4-bf84-4561-adc1-a86e96ec511f tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-71abd7f4-bf84-4561-adc1-a86e96ec511f tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-71abd7f4-bf84-4561-adc1-a86e96ec511f tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-71abd7f4-bf84-4561-adc1-a86e96ec511f tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-71abd7f4-bf84-4561-adc1-a86e96ec511f tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:52 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-71abd7f4-bf84-4561-adc1-a86e96ec511f tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2c63a8fe9f4992b7ff2aa75a6c4b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4386d41a22343b185f320b3f90d1a83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:50:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-71abd7f4-bf84-4561-adc1-a86e96ec511f tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" status: 200 len: 1485 microversion: 2.1 time: 0.234989 Nov 28 06:50:52 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 236/708] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:50:51 2023] GET /compute/v2.1/servers/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 => generated 1485 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:50:53 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-plugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}, {"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-plugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Creating event network-vif-plugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:50:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] Creating event network-vif-plugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:50:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-ec38d844-fa52-425e-9bd3-a302addc76a5 req-6fdd0392-ad87-481d-adf2-9dd28e56b094 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053046 Nov 28 06:50:53 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 241/709] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-plugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:50:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] Creating event network-vif-plugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:50:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-54e119a4-025e-4976-8119-9e6278a3f887 req-31afc5d9-1a4c-476c-b8d8-3799a433ce3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037721 Nov 28 06:50:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 233/710] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:50:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:50:57 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:57 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:57 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:57 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lazy-loading 'services' on Instance uuid c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] HTTP exception thrown: Instance c7a2db07-1739-4fa5-b444-86d602ca586f could not be found. Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Returning 404 to user: Instance c7a2db07-1739-4fa5-b444-86d602ca586f could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:50:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-6091c0a2-ad96-4a62-83cb-e67566c99672 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f" status: 404 len: 111 microversion: 2.42 time: 0.054953 Nov 28 06:50:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 242/711] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:50:57 2023] GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:50:57 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-f89725f0-6971-404a-8111-356cc8154cf5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/os-volume_attachments/742921c3-d954-4a45-a388-876267a6379d" status: 202 len: 0 microversion: 2.1 time: 0.170002 Nov 28 06:50:57 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 237/712] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:50:57 2023] DELETE /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/os-volume_attachments/742921c3-d954-4a45-a388-876267a6379d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:50:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-40d31666-9d32-4d3c-9fce-e3fd0b11c41a tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '.version_select at 0x7f0b039fca60>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-40d31666-9d32-4d3c-9fce-e3fd0b11c41a tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-651126540" status: 204 len: 0 microversion: 2.42 time: 0.023052 Nov 28 06:50:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 234/713] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 28 06:50:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-651126540 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7f44ee98-29b6-4998-9a13-d1f5d3342f5a tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7f44ee98-29b6-4998-9a13-d1f5d3342f5a tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7f44ee98-29b6-4998-9a13-d1f5d3342f5a tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7f44ee98-29b6-4998-9a13-d1f5d3342f5a tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7f44ee98-29b6-4998-9a13-d1f5d3342f5a tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7f44ee98-29b6-4998-9a13-d1f5d3342f5a tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7f44ee98-29b6-4998-9a13-d1f5d3342f5a tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:50:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7f44ee98-29b6-4998-9a13-d1f5d3342f5a tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:50:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7f44ee98-29b6-4998-9a13-d1f5d3342f5a tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061388 Nov 28 06:50:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 243/714] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:50:57 2023] GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:00 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:00 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] HTTP exception thrown: Instance c7a2db07-1739-4fa5-b444-86d602ca586f could not be found. Nov 28 06:51:00 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Returning 404 to user: Instance c7a2db07-1739-4fa5-b444-86d602ca586f could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:51:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-18a1bdb4-4315-4f58-bb76-fb94352277ae tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f" status: 404 len: 111 microversion: 2.42 time: 0.026493 Nov 28 06:51:00 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 238/715] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:51:00 2023] DELETE /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:51:00 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:00 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] [instance: c7a2db07-1739-4fa5-b444-86d602ca586f] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] HTTP exception thrown: Instance c7a2db07-1739-4fa5-b444-86d602ca586f could not be found. Nov 28 06:51:00 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] Returning 404 to user: Instance c7a2db07-1739-4fa5-b444-86d602ca586f could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:51:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-910c7145-f6b1-4e93-9795-99e54ca5d5a7 tempest-TaggedBootDevicesTest_v242-976904504 tempest-TaggedBootDevicesTest_v242-976904504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f" status: 404 len: 111 microversion: 2.42 time: 0.027809 Nov 28 06:51:00 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 235/716] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:51:00 2023] GET /compute/v2.1/servers/c7a2db07-1739-4fa5-b444-86d602ca586f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:51:02 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:02 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:02 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lazy-loading 'services' on Instance uuid ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:51:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-57afc968-b9b8-48cc-9298-a60729ed7197 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/36d2fb26-6898-433b-8c8e-7818cf21bd13" status: 202 len: 0 microversion: 2.1 time: 0.174779 Nov 28 06:51:02 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 244/717] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:51:02 2023] DELETE /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/36d2fb26-6898-433b-8c8e-7818cf21bd13 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:51:02 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-7761a031-1eca-4ad1-a8c5-999bff857aad tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:02 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-7761a031-1eca-4ad1-a8c5-999bff857aad tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7761a031-1eca-4ad1-a8c5-999bff857aad tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7761a031-1eca-4ad1-a8c5-999bff857aad tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7761a031-1eca-4ad1-a8c5-999bff857aad tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7761a031-1eca-4ad1-a8c5-999bff857aad tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7761a031-1eca-4ad1-a8c5-999bff857aad tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-7761a031-1eca-4ad1-a8c5-999bff857aad tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:02 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-7761a031-1eca-4ad1-a8c5-999bff857aad tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058070 Nov 28 06:51:02 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 239/718] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:51:02 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:23 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lazy-loading 'services' on Instance uuid 30c7dc1e-9569-49f5-aabf-a98cba6470fa {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:51:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f7df6b44-1dcc-426b-a023-7abb1d5014f3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/os-volume_attachments/0ceba6e2-fc04-4dc6-ab19-055561d21e27" status: 202 len: 0 microversion: 2.1 time: 0.180601 Nov 28 06:51:23 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 236/719] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:51:23 2023] DELETE /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/os-volume_attachments/0ceba6e2-fc04-4dc6-ab19-055561d21e27 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:51:23 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=28 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:23 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:23 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a9cde2c6-bfc5-4953-a2f4-dad6f3243ba2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:23 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a9cde2c6-bfc5-4953-a2f4-dad6f3243ba2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a9cde2c6-bfc5-4953-a2f4-dad6f3243ba2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a9cde2c6-bfc5-4953-a2f4-dad6f3243ba2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a9cde2c6-bfc5-4953-a2f4-dad6f3243ba2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a9cde2c6-bfc5-4953-a2f4-dad6f3243ba2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a9cde2c6-bfc5-4953-a2f4-dad6f3243ba2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a9cde2c6-bfc5-4953-a2f4-dad6f3243ba2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:23 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a9cde2c6-bfc5-4953-a2f4-dad6f3243ba2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058152 Nov 28 06:51:23 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 245/720] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:51:23 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:24 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:24 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-4eb1e5e4-f7de-4617-ad38-8a96cf239199 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Action: 'create', calling method: .version_select at 0x7f0b03dec790>, body: {"keypair": {"name": "tempest-keypair-259314972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgppLb2kNYG5hyeE0SEPq0PFajgXAsCK1knJv+jOVeGkDLsXyFItKhJE8Nomj2oA0/dnErgSFuw7MdhLob2xlyJnLrkin+BS1Fq0CIEv5UHpjZO84gELSv312s7eJMXCA=="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:24 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-4eb1e5e4-f7de-4617-ad38-8a96cf239199 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting quotas for project 9d769a1c976c468f804770d89c92ae94. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:51:24 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-4eb1e5e4-f7de-4617-ad38-8a96cf239199 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting quotas for user dbf659ad4b8f43a2bc497d01be58d846 and project 9d769a1c976c468f804770d89c92ae94. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:51:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-4eb1e5e4-f7de-4617-ad38-8a96cf239199 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.171185 Nov 28 06:51:24 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 240/721] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 06:51:24 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 06:51:24 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:24 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:25 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'services' on Instance uuid bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:51:25 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-27fe7c8d-85b5-4e31-ba21-9b444677be7b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/os-volume_attachments/142a655f-e1de-4c08-b7e5-e81e50cf760f" status: 202 len: 0 microversion: 2.1 time: 0.287282 Nov 28 06:51:25 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 237/722] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:51:24 2023] DELETE /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/os-volume_attachments/142a655f-e1de-4c08-b7e5-e81e50cf760f => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:51:25 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-161739875", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "33d7ba92-eb3a-4951-905c-54f3d9532751"}], "security_groups": [{"name": "tempest-securitygroup--1911579002"}], "key_name": "tempest-keypair-259314972", "user_data": "}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:25 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] validate_networks() for [('33d7ba92-eb3a-4951-905c-54f3d9532751', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting quotas for project 9d769a1c976c468f804770d89c92ae94. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting quotas for user dbf659ad4b8f43a2bc497d01be58d846 and project 9d769a1c976c468f804770d89c92ae94. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:51:26 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:51:26 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-018c753b-32a9-45e7-ac33-318954cab294 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.926426 Nov 28 06:51:26 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 246/723] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 06:51:25 2023] POST /compute/v2.1/servers => generated 400 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 06:51:26 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-f7f0626b-d23e-4248-856d-fd2feb4c60b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:26 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-f7f0626b-d23e-4248-856d-fd2feb4c60b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:26 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-f7f0626b-d23e-4248-856d-fd2feb4c60b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:51:26 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-f7f0626b-d23e-4248-856d-fd2feb4c60b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:51:26 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-f7f0626b-d23e-4248-856d-fd2feb4c60b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:51:26 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-f7f0626b-d23e-4248-856d-fd2feb4c60b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 200 len: 1272 microversion: 2.20 time: 0.070028 Nov 28 06:51:26 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 241/724] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:51:26 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 1272 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:51:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] Creating event network-changed:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:51:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-dbf78720-234a-4280-8a4c-8e5e908b3e9f req-ae46a63b-7154-43ba-931f-e8c689731ca3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028677 Nov 28 06:51:29 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 238/725] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:31 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-plugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] Creating event network-vif-plugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:51:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-355b5582-a2cd-43b9-bddb-52cce0347f09 req-b4173af9-0b83-478b-b650-64d3fedfb275 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045608 Nov 28 06:51:31 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 247/726] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:51:31 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:31 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] HTTP exception thrown: Instance 75046337-1afd-4458-a305-9922679ce7e3 could not be found. Nov 28 06:51:31 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Returning 404 to user: Instance 75046337-1afd-4458-a305-9922679ce7e3 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:51:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1f163051-e5de-4e13-90ce-8ea14fa1cbbc tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3" status: 404 len: 111 microversion: 2.49 time: 0.049869 Nov 28 06:51:31 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 242/727] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:51:31 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:51:31 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-51541863-9263-46e7-961d-d7b45c9d2e86 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '.version_select at 0x7f0b03a72d40>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-51541863-9263-46e7-961d-d7b45c9d2e86 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-847145216" status: 204 len: 0 microversion: 2.49 time: 0.026853 Nov 28 06:51:32 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 239/728] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 28 06:51:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-847145216 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:51:33 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:33 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:33 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:33 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] HTTP exception thrown: Instance 75046337-1afd-4458-a305-9922679ce7e3 could not be found. Nov 28 06:51:33 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Returning 404 to user: Instance 75046337-1afd-4458-a305-9922679ce7e3 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:51:33 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-3410aa4d-52c0-4399-be74-cac661d19c96 tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3" status: 404 len: 111 microversion: 2.49 time: 0.028761 Nov 28 06:51:33 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 248/729] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:51:33 2023] DELETE /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:51:33 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:33 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] [instance: 75046337-1afd-4458-a305-9922679ce7e3] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:33 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] HTTP exception thrown: Instance 75046337-1afd-4458-a305-9922679ce7e3 could not be found. Nov 28 06:51:33 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] Returning 404 to user: Instance 75046337-1afd-4458-a305-9922679ce7e3 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:51:33 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6ff85314-0272-4cf6-813e-49c7455d23ac tempest-TaggedAttachmentsTest-2015143516 tempest-TaggedAttachmentsTest-2015143516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3" status: 404 len: 111 microversion: 2.49 time: 0.028075 Nov 28 06:51:33 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 243/730] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:51:33 2023] GET /compute/v2.1/servers/75046337-1afd-4458-a305-9922679ce7e3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:51:33 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-plugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] Creating event network-vif-plugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:51:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-87289b8a-88cc-483a-8710-dcf52367f963 req-39dc6851-5ae7-4b18-8227-ccea825f4cd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038342 Nov 28 06:51:33 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 240/731] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e716a2dc-3b37-459e-aaa9-dd0d68a5312c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e716a2dc-3b37-459e-aaa9-dd0d68a5312c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e716a2dc-3b37-459e-aaa9-dd0d68a5312c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e716a2dc-3b37-459e-aaa9-dd0d68a5312c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e716a2dc-3b37-459e-aaa9-dd0d68a5312c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e716a2dc-3b37-459e-aaa9-dd0d68a5312c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e716a2dc-3b37-459e-aaa9-dd0d68a5312c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e716a2dc-3b37-459e-aaa9-dd0d68a5312c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:40 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-e716a2dc-3b37-459e-aaa9-dd0d68a5312c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:51:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e716a2dc-3b37-459e-aaa9-dd0d68a5312c tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a" status: 200 len: 1715 microversion: 2.1 time: 0.287920 Nov 28 06:51:40 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 249/732] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:51:40 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a => generated 1715 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "9827cec7-b26b-48dc-9a84-87c46159915f"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:44 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lazy-loading 'flavor' on Instance uuid 3a328017-e6a2-4b35-a18d-d51a14e29895 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:51:44 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5bd7765b-abef-4f34-85cf-8a3b2fae6809 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895/action" status: 200 len: 29 microversion: 2.87 time: 0.588091 Nov 28 06:51:44 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 244/733] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 06:51:44 2023] POST /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895/action => generated 29 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:51:44 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:44 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:51:44 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:44 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:44 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:45 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:51:45 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:51:45 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:51:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-96da1403-5fbd-475d-b71b-f24f791cbf05 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895" status: 200 len: 1775 microversion: 2.87 time: 0.752588 Nov 28 06:51:45 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 241/734] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:51:44 2023] GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895 => generated 1775 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:51:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-unplugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] Creating event network-vif-unplugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:51:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-b3c6bc8a-01e7-48e5-8c9e-45a2f4f3d180 req-b309b3e2-3b06-43b9-b9ad-606f45b8ad2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042647 Nov 28 06:51:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 250/735] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:47 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c3a308fb-902e-4e15-8ec0-562fc9609542 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b03decd30>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:47 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c3a308fb-902e-4e15-8ec0-562fc9609542 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5f2b2ae4-77e7-4703-915c-850c3fb5790f" status: 200 len: 350 microversion: 2.1 time: 0.093802 Nov 28 06:51:47 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 245/736] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:51:47 2023] GET /compute/v2.1/os-volumes/5f2b2ae4-77e7-4703-915c-850c3fb5790f => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:47 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:47 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-03e9760a-172a-416d-a4c7-28443e6a5882 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:47 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-03e9760a-172a-416d-a4c7-28443e6a5882 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03e9760a-172a-416d-a4c7-28443e6a5882 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03e9760a-172a-416d-a4c7-28443e6a5882 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03e9760a-172a-416d-a4c7-28443e6a5882 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03e9760a-172a-416d-a4c7-28443e6a5882 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03e9760a-172a-416d-a4c7-28443e6a5882 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03e9760a-172a-416d-a4c7-28443e6a5882 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Going to try to stop instance {{(pid=64871) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 28 06:51:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e040cebe-fa5f-4d24-928d-c585a2c4432a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/action" status: 202 len: 0 microversion: 2.1 time: 0.218215 Nov 28 06:51:48 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 242/737] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:51:47 2023] POST /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:51:48 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-03e9760a-172a-416d-a4c7-28443e6a5882 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.166517 Nov 28 06:51:48 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 251/738] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:51:47 2023] GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db/os-volume_attachments => generated 25 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ce8d479c-8442-42d2-99ef-2a1432299994 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-ce8d479c-8442-42d2-99ef-2a1432299994 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ce8d479c-8442-42d2-99ef-2a1432299994 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ce8d479c-8442-42d2-99ef-2a1432299994 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ce8d479c-8442-42d2-99ef-2a1432299994 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ce8d479c-8442-42d2-99ef-2a1432299994 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ce8d479c-8442-42d2-99ef-2a1432299994 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ce8d479c-8442-42d2-99ef-2a1432299994 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:51:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-b29f2135-d496-41f8-9f7b-4401ad6b08c1 req-a9dee498-6d69-41b9-9694-8a501560bf2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054365 Nov 28 06:51:48 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 243/739] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-ce8d479c-8442-42d2-99ef-2a1432299994 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:51:48 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-ce8d479c-8442-42d2-99ef-2a1432299994 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1663 microversion: 2.1 time: 0.222253 Nov 28 06:51:48 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 246/740] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:51:48 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1663 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:51:48 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7fd0c76d-1edc-4af8-94f9-aa69aa848066 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" status: 204 len: 0 microversion: 2.1 time: 0.179458 Nov 28 06:51:48 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 252/741] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:51:48 2023] DELETE /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-7fffcb34-d917-472a-b35c-47311f4b8887 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-7fffcb34-d917-472a-b35c-47311f4b8887 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7fffcb34-d917-472a-b35c-47311f4b8887 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7fffcb34-d917-472a-b35c-47311f4b8887 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7fffcb34-d917-472a-b35c-47311f4b8887 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7fffcb34-d917-472a-b35c-47311f4b8887 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7fffcb34-d917-472a-b35c-47311f4b8887 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7fffcb34-d917-472a-b35c-47311f4b8887 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-unplugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] Creating event network-vif-unplugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:51:48 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-fd3bd32d-ed97-4283-ac3b-60df61c43fff req-d02c292f-6532-465d-ba07-5e7beb357d90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036413 Nov 28 06:51:48 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 247/742] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:48 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-7fffcb34-d917-472a-b35c-47311f4b8887 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e396090c4b4a8995d8d2e66c8b3db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9ec769206481e8dad48a6461c46ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:51:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-7fffcb34-d917-472a-b35c-47311f4b8887 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" status: 200 len: 1668 microversion: 2.1 time: 0.381240 Nov 28 06:51:48 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 244/743] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:51:48 2023] GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db => generated 1668 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db", "name": "network-vif-unplugged", "status": "completed", "tag": "b7c5e041-ed7b-4c47-96b6-dbebd8356786"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:48 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] Creating event network-vif-unplugged:b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db on user Nov 28 06:51:48 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-dd88093b-39ca-4dec-b751-4a05105cdc34 req-8c066117-8921-467f-8fee-1775d5f049c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032672 Nov 28 06:51:48 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 253/744] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-19184afd-3d37-45a2-bb1b-66e0f84811e9 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b03adf1c0>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-19184afd-3d37-45a2-bb1b-66e0f84811e9 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/003ec51b-e39d-40ab-9fcf-d92dc1740af3" status: 200 len: 351 microversion: 2.1 time: 0.050651 Nov 28 06:51:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 248/745] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:51:49 2023] GET /compute/v2.1/os-volumes/003ec51b-e39d-40ab-9fcf-d92dc1740af3 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-plugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}, {"server_uuid": "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db", "name": "network-vif-deleted", "tag": "b7c5e041-ed7b-4c47-96b6-dbebd8356786"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] Creating event network-vif-plugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:51:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] Creating event network-vif-deleted:b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db on user Nov 28 06:51:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-e9ede022-1ee4-48aa-a2e7-7a5dcbef890e req-9cf9c822-8e54-49be-af5f-424e8ac8dd25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033092 Nov 28 06:51:50 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 245/746] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:50 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db", "name": "network-vif-plugged", "status": "completed", "tag": "b7c5e041-ed7b-4c47-96b6-dbebd8356786"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] Creating event network-vif-plugged:b7c5e041-ed7b-4c47-96b6-dbebd8356786 for instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db on user Nov 28 06:51:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-15ede53b-5a8f-41a2-b755-fe8ea0959126 req-89c05391-5ba1-4e3b-a684-fe0be2cef661 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033919 Nov 28 06:51:50 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 254/747] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:51:51 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:51:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-119feccd-4707-4b58-8bf5-b920457be887 req-d32399f1-6e6c-4822-99cf-71dc0d893f32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038433 Nov 28 06:51:51 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 249/748] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6e0b67e6-59b4-439b-b79b-b75b0a9bceea tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b037f88b0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6e0b67e6-59b4-439b-b79b-b75b0a9bceea tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/43755e62-1305-48a6-a794-e88640950a73" status: 200 len: 351 microversion: 2.1 time: 0.149190 Nov 28 06:51:52 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 246/749] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:51:52 2023] GET /compute/v2.1/os-volumes/43755e62-1305-48a6-a794-e88640950a73 => generated 351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-52c16365-af50-4fb5-9fc8-69e258c616c3 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b0375eb00>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-52c16365-af50-4fb5-9fc8-69e258c616c3 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088523 Nov 28 06:51:52 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 255/750] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 28 06:51:52 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9da8e828-8cda-419d-aeba-69e7ecee3d28 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b03decdc0>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9da8e828-8cda-419d-aeba-69e7ecee3d28 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.107863 Nov 28 06:51:52 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 250/751] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Nov 28 06:51:52 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-58afe783-beb1-4e6c-8d38-3095f7cf4f19 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b037f8940>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-2fcca69a-f25f-4667-bbf3-0a6ef8eca494 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-2fcca69a-f25f-4667-bbf3-0a6ef8eca494 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2fcca69a-f25f-4667-bbf3-0a6ef8eca494 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2fcca69a-f25f-4667-bbf3-0a6ef8eca494 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2fcca69a-f25f-4667-bbf3-0a6ef8eca494 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2fcca69a-f25f-4667-bbf3-0a6ef8eca494 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2fcca69a-f25f-4667-bbf3-0a6ef8eca494 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2fcca69a-f25f-4667-bbf3-0a6ef8eca494 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-2fcca69a-f25f-4667-bbf3-0a6ef8eca494 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046369 Nov 28 06:51:52 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 256/752] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:51:52 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:52 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-58afe783-beb1-4e6c-8d38-3095f7cf4f19 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.134830 Nov 28 06:51:52 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 247/753] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 28 06:51:52 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5782c800-ff8e-4568-8697-38dcf2d09533 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b03adc5e0>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:51:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5782c800-ff8e-4568-8697-38dcf2d09533 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087130 Nov 28 06:51:52 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 251/754] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Nov 28 06:51:52 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5a9ef50b-fd21-4b0e-a9ea-5cc910d48a72 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b03911360>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-5a9cb0b0-1ee6-4cde-b0ae-fb0f23a5f344 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" status: 204 len: 0 microversion: 2.1 time: 0.119750 Nov 28 06:51:52 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 257/755] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:51:52 2023] DELETE /compute/v2.1/servers/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a39e553f-f9be-480e-985e-f70f2d40b059 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a39e553f-f9be-480e-985e-f70f2d40b059 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a39e553f-f9be-480e-985e-f70f2d40b059 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a39e553f-f9be-480e-985e-f70f2d40b059 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a39e553f-f9be-480e-985e-f70f2d40b059 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a39e553f-f9be-480e-985e-f70f2d40b059 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a39e553f-f9be-480e-985e-f70f2d40b059 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a39e553f-f9be-480e-985e-f70f2d40b059 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:52 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5a9ef50b-fd21-4b0e-a9ea-5cc910d48a72 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087616 Nov 28 06:51:52 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 248/756] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Nov 28 06:51:52 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-943afe8c-aed5-4870-8972-232e7112d5f6 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b037fa710>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:52 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lazy-loading 'services' on Instance uuid ab422771-7c11-4074-b4a6-d793c790e813 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:51:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-943afe8c-aed5-4870-8972-232e7112d5f6 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.141906 Nov 28 06:51:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 249/757] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 28 06:51:52 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:51:53 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-a39e553f-f9be-480e-985e-f70f2d40b059 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2c63a8fe9f4992b7ff2aa75a6c4b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4386d41a22343b185f320b3f90d1a83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:51:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a39e553f-f9be-480e-985e-f70f2d40b059 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" status: 200 len: 1491 microversion: 2.1 time: 0.284788 Nov 28 06:51:53 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 258/758] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:51:52 2023] GET /compute/v2.1/servers/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 => generated 1491 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:51:53 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:53 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6a95c1f3-1289-4914-a310-14ea6202fa86 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b0375f0a0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:51:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-5087c551-e6b9-4bcb-9290-22669fe3d342 req-45bcc456-13c4-42ec-a75b-e9c3ec758ce7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027854 Nov 28 06:51:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 250/759] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-6a95c1f3-1289-4914-a310-14ea6202fa86 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.075935 Nov 28 06:51:53 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 259/760] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Nov 28 06:51:53 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:53 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-411431d8-98f4-4c06-8f37-b19339060000 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] Calling method '.version_select at 0x7f0b03a70ee0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:53 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-fe12c63d-0643-4701-a8ac-a34696c8d3de tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712" status: 202 len: 0 microversion: 2.1 time: 0.599396 Nov 28 06:51:53 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 252/761] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:51:52 2023] DELETE /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712 => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:51:53 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7404b6b8-0d1c-4b7d-86bd-d1f89e1a2223 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:51:53 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7404b6b8-0d1c-4b7d-86bd-d1f89e1a2223 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:51:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7404b6b8-0d1c-4b7d-86bd-d1f89e1a2223 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7404b6b8-0d1c-4b7d-86bd-d1f89e1a2223 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7404b6b8-0d1c-4b7d-86bd-d1f89e1a2223 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7404b6b8-0d1c-4b7d-86bd-d1f89e1a2223 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7404b6b8-0d1c-4b7d-86bd-d1f89e1a2223 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:53 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7404b6b8-0d1c-4b7d-86bd-d1f89e1a2223 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:53 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6", "name": "network-vif-unplugged", "status": "completed", "tag": "632eb6d0-1687-4fac-a60d-f919d2ea0941"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-411431d8-98f4-4c06-8f37-b19339060000 tempest-VolumesTestJSON-1284486443 tempest-VolumesTestJSON-1284486443-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.123389 Nov 28 06:51:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 251/762] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 28 06:51:53 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:51:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:53 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] Creating event network-vif-unplugged:632eb6d0-1687-4fac-a60d-f919d2ea0941 for instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 on user Nov 28 06:51:53 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7404b6b8-0d1c-4b7d-86bd-d1f89e1a2223 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074520 Nov 28 06:51:53 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 260/763] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:51:53 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:51:53 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-9bd941e1-4a74-4072-bb8d-d7ab184a1247 req-fc073ba4-819c-4e3e-ba6f-e94775298b23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044188 Nov 28 06:51:53 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 253/764] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:51:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-3ec1970a-d35c-490f-9185-73c8aeab4200 req-be19cfee-fb7c-4fd2-9350-dee7f6a66c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6", "name": "network-vif-deleted", "tag": "632eb6d0-1687-4fac-a60d-f919d2ea0941"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3ec1970a-d35c-490f-9185-73c8aeab4200 req-be19cfee-fb7c-4fd2-9350-dee7f6a66c3d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3ec1970a-d35c-490f-9185-73c8aeab4200 req-be19cfee-fb7c-4fd2-9350-dee7f6a66c3d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-3ec1970a-d35c-490f-9185-73c8aeab4200 req-be19cfee-fb7c-4fd2-9350-dee7f6a66c3d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-3ec1970a-d35c-490f-9185-73c8aeab4200 req-be19cfee-fb7c-4fd2-9350-dee7f6a66c3d service nova] Creating event network-vif-deleted:632eb6d0-1687-4fac-a60d-f919d2ea0941 for instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 on user Nov 28 06:51:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-3ec1970a-d35c-490f-9185-73c8aeab4200 req-be19cfee-fb7c-4fd2-9350-dee7f6a66c3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045858 Nov 28 06:51:54 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 252/765] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:51:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69fbbd9-cf47-4ef8-8a60-848ee895a8e6", "name": "network-vif-plugged", "status": "completed", "tag": "632eb6d0-1687-4fac-a60d-f919d2ea0941"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:51:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:51:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:51:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:51:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] Creating event network-vif-plugged:632eb6d0-1687-4fac-a60d-f919d2ea0941 for instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 on user Nov 28 06:51:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-6523ba5a-6c8a-4bba-893a-8a414f90d091 req-0bb8a369-4f49-4767-a4ca-24f1dc83cb0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038403 Nov 28 06:51:55 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 261/766] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:51:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:52:13 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=12 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:13 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:13 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-be3af774-a24c-445d-aad7-27df62bc4a7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:13 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-be3af774-a24c-445d-aad7-27df62bc4a7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be3af774-a24c-445d-aad7-27df62bc4a7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be3af774-a24c-445d-aad7-27df62bc4a7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be3af774-a24c-445d-aad7-27df62bc4a7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be3af774-a24c-445d-aad7-27df62bc4a7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be3af774-a24c-445d-aad7-27df62bc4a7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:13 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be3af774-a24c-445d-aad7-27df62bc4a7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:13 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-be3af774-a24c-445d-aad7-27df62bc4a7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052286 Nov 28 06:52:13 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 254/767] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:52:13 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=16 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:13 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:52:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-4f219463-32f1-410b-9866-61bd78655b7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa" status: 204 len: 0 microversion: 2.1 time: 0.127752 Nov 28 06:52:13 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 253/768] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:52:13 2023] DELETE /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:52:13 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:13 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:13 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-723a41a9-2a9e-4951-a1b0-d0c1911a10e9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:13 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-723a41a9-2a9e-4951-a1b0-d0c1911a10e9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723a41a9-2a9e-4951-a1b0-d0c1911a10e9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723a41a9-2a9e-4951-a1b0-d0c1911a10e9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723a41a9-2a9e-4951-a1b0-d0c1911a10e9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723a41a9-2a9e-4951-a1b0-d0c1911a10e9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723a41a9-2a9e-4951-a1b0-d0c1911a10e9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-723a41a9-2a9e-4951-a1b0-d0c1911a10e9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:14 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "name": "network-vif-unplugged", "status": "completed", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:52:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] Creating event network-vif-unplugged:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:52:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-c761bb2c-2551-4598-9139-d4b199a64a1b req-469f75c1-b595-4581-abcf-6e3f2c926031 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030143 Nov 28 06:52:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 255/769] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:52:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:14 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-723a41a9-2a9e-4951-a1b0-d0c1911a10e9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:52:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-723a41a9-2a9e-4951-a1b0-d0c1911a10e9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa" status: 200 len: 1683 microversion: 2.1 time: 0.379888 Nov 28 06:52:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 262/770] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:52:13 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa => generated 1683 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:52:16 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "name": "network-vif-plugged", "status": "completed", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}, {"server_uuid": "30c7dc1e-9569-49f5-aabf-a98cba6470fa", "name": "network-vif-deleted", "tag": "5a6dbf47-1250-4f02-87b4-6d33d64d34eb"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:52:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] Creating event network-vif-plugged:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:52:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] Creating event network-vif-deleted:5a6dbf47-1250-4f02-87b4-6d33d64d34eb for instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa on user Nov 28 06:52:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-877cd68b-ba52-4419-8550-4b6ee740b37f req-897a10b3-280e-4492-9ec1-995adef1726e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032871 Nov 28 06:52:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 254/771] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:52:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:16 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:17 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:52:17 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:52:17 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:52:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-fd21e882-c545-47af-ad3f-8d2f45b1266f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 200 len: 1583 microversion: 2.20 time: 0.338128 Nov 28 06:52:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 256/772] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:52:16 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 1583 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:52:35 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:52:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1667af81-b423-4704-98d8-00061b94c5b9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895" status: 200 len: 1755 microversion: 2.87 time: 0.236119 Nov 28 06:52:35 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 263/773] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:52:35 2023] GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895 => generated 1755 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-31418831-ccf5-4ee5-98e8-f2d317a672ba tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-31418831-ccf5-4ee5-98e8-f2d317a672ba tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-31418831-ccf5-4ee5-98e8-f2d317a672ba tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-31418831-ccf5-4ee5-98e8-f2d317a672ba tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-31418831-ccf5-4ee5-98e8-f2d317a672ba tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-31418831-ccf5-4ee5-98e8-f2d317a672ba tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-31418831-ccf5-4ee5-98e8-f2d317a672ba tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-31418831-ccf5-4ee5-98e8-f2d317a672ba tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:38 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-31418831-ccf5-4ee5-98e8-f2d317a672ba tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:52:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-31418831-ccf5-4ee5-98e8-f2d317a672ba tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1640 microversion: 2.1 time: 0.226734 Nov 28 06:52:38 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 255/774] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:52:38 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1640 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=14 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db could not be found. Nov 28 06:52:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-a6150b2f-f402-4325-bc2a-5f59e8fc7252 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" status: 404 len: 111 microversion: 2.1 time: 0.031548 Nov 28 06:52:38 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 257/775] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:52:38 2023] GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-84da06d4-6728-4f29-9fd5-c2a4dde42943 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '.version_select at 0x7f0b0375eef0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-84da06d4-6728-4f29-9fd5-c2a4dde42943 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-923733588" status: 202 len: 0 microversion: 2.1 time: 0.024066 Nov 28 06:52:38 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 264/776] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 06:52:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-923733588 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:52:40 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-93748989-f064-4a82-90b4-b35a9871afec tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:40 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-93748989-f064-4a82-90b4-b35a9871afec tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93748989-f064-4a82-90b4-b35a9871afec tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93748989-f064-4a82-90b4-b35a9871afec tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93748989-f064-4a82-90b4-b35a9871afec tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93748989-f064-4a82-90b4-b35a9871afec tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93748989-f064-4a82-90b4-b35a9871afec tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-93748989-f064-4a82-90b4-b35a9871afec tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-93748989-f064-4a82-90b4-b35a9871afec tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.181177 Nov 28 06:52:40 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 256/777] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:52:40 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-interface => generated 282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:41 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:52:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] Creating event network-changed:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:52:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-9c5ec6f9-5b8c-4b62-9967-215c9343a0e8 req-4b9eac5a-e90e-420e-a3d8-2648911f1010 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028372 Nov 28 06:52:41 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 258/778] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:52:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:41 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:41 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:41 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lazy-loading 'services' on Instance uuid de112cbb-849e-43c1-961a-4457585f2e9a {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:52:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d6a2b1ca-ecdd-483a-9381-600fa65bdace tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-volume_attachments/daa2eb88-295a-4c93-81a0-3f799e732e97" status: 202 len: 0 microversion: 2.1 time: 0.423874 Nov 28 06:52:42 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 265/779] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:52:41 2023] DELETE /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-volume_attachments/daa2eb88-295a-4c93-81a0-3f799e732e97 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:52:42 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-501b1f15-5d49-4d27-a92e-a390a2207ea2 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:42 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-501b1f15-5d49-4d27-a92e-a390a2207ea2 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-501b1f15-5d49-4d27-a92e-a390a2207ea2 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-501b1f15-5d49-4d27-a92e-a390a2207ea2 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-501b1f15-5d49-4d27-a92e-a390a2207ea2 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-501b1f15-5d49-4d27-a92e-a390a2207ea2 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-501b1f15-5d49-4d27-a92e-a390a2207ea2 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-501b1f15-5d49-4d27-a92e-a390a2207ea2 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:42 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-501b1f15-5d49-4d27-a92e-a390a2207ea2 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052160 Nov 28 06:52:42 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 257/780] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:52:42 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:42 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:42 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:42 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db could not be found. Nov 28 06:52:42 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:42 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-81e22b4b-4eb2-4d19-968d-755cb33af3e5 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" status: 404 len: 111 microversion: 2.1 time: 0.033211 Nov 28 06:52:42 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 259/781] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:52:42 2023] DELETE /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:42 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:42 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db could not be found. Nov 28 06:52:42 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-c39fe6a2-c75f-4925-a8c5-4c9cf0ae4531 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db" status: 404 len: 111 microversion: 2.1 time: 0.035748 Nov 28 06:52:42 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 266/782] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:52:42 2023] GET /compute/v2.1/servers/c01463c9-d2d2-4eee-b9b7-8e7f45f5b9db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: f69fbbd9-cf47-4ef8-8a60-848ee895a8e6] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] HTTP exception thrown: Instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 could not be found. Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Returning 404 to user: Instance f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d93d1bf1-8edc-4f4e-91cf-8db86706da82 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6" status: 404 len: 111 microversion: 2.1 time: 0.026491 Nov 28 06:52:43 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 258/783] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:52:43 2023] GET /compute/v2.1/servers/f69fbbd9-cf47-4ef8-8a60-848ee895a8e6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:43 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-520150813", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "45c733cf-4326-405a-9d99-92df8dc47b61"}]}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:52:43 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] validate_networks() for [('45c733cf-4326-405a-9d99-92df8dc47b61', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-36935b9f-00bc-4eff-a6ea-1355f4fbb353 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-36935b9f-00bc-4eff-a6ea-1355f4fbb353 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-36935b9f-00bc-4eff-a6ea-1355f4fbb353 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-36935b9f-00bc-4eff-a6ea-1355f4fbb353 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-36935b9f-00bc-4eff-a6ea-1355f4fbb353 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-36935b9f-00bc-4eff-a6ea-1355f4fbb353 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-36935b9f-00bc-4eff-a6ea-1355f4fbb353 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-36935b9f-00bc-4eff-a6ea-1355f4fbb353 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-36935b9f-00bc-4eff-a6ea-1355f4fbb353 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062720 Nov 28 06:52:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 267/784] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:52:43 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] Creating event network-changed:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:52:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-7f6d3eb6-45fe-4225-9734-39bed86222a4 req-a8b6ac1a-9f11-40d1-aa15-1a516a0fe088 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047868 Nov 28 06:52:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 268/785] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:52:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] HTTP exception thrown: Instance ab422771-7c11-4074-b4a6-d793c790e813 is not attached to volume 099bd1dc-45f7-4f2f-9e1f-f47124112712 Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Returning 404 to user: Instance ab422771-7c11-4074-b4a6-d793c790e813 is not attached to volume 099bd1dc-45f7-4f2f-9e1f-f47124112712 {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b7fa84c5-342f-46a0-b559-0a898f9aa539 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712" status: 404 len: 154 microversion: 2.1 time: 0.113751 Nov 28 06:52:43 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 259/786] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:52:43 2023] DELETE /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813/os-volume_attachments/099bd1dc-45f7-4f2f-9e1f-f47124112712 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:43 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:52:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d679d848-223b-4727-9569-5ea85dcb0e19 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813" status: 204 len: 0 microversion: 2.1 time: 0.187069 Nov 28 06:52:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 269/787] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:52:43 2023] DELETE /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-75a5dfa0-857f-4217-89ff-063a51d64ae1 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-75a5dfa0-857f-4217-89ff-063a51d64ae1 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75a5dfa0-857f-4217-89ff-063a51d64ae1 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75a5dfa0-857f-4217-89ff-063a51d64ae1 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75a5dfa0-857f-4217-89ff-063a51d64ae1 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75a5dfa0-857f-4217-89ff-063a51d64ae1 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75a5dfa0-857f-4217-89ff-063a51d64ae1 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-75a5dfa0-857f-4217-89ff-063a51d64ae1 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Getting quotas for project d4386d41a22343b185f320b3f90d1a83. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Getting quotas for user 9a2c63a8fe9f4992b7ff2aa75a6c4b86 and project d4386d41a22343b185f320b3f90d1a83. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:52:44 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:52:44 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-047d6727-7dcc-45f1-8152-6750be1c823a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.102844 Nov 28 06:52:44 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 260/788] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:52:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:52:44 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1c460e19-8e0c-4d80-9dbe-caf1afdf7b0a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:44 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1c460e19-8e0c-4d80-9dbe-caf1afdf7b0a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:44 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1c460e19-8e0c-4d80-9dbe-caf1afdf7b0a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2c63a8fe9f4992b7ff2aa75a6c4b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4386d41a22343b185f320b3f90d1a83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:52:44 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1c460e19-8e0c-4d80-9dbe-caf1afdf7b0a tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" status: 200 len: 1205 microversion: 2.1 time: 0.096173 Nov 28 06:52:44 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 270/789] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:52:44 2023] GET /compute/v2.1/servers/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 => generated 1205 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:52:44 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-75a5dfa0-857f-4217-89ff-063a51d64ae1 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b878f5054743d690f01e77e7425371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55617103c9e348b3bc963810362acb6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:52:44 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-75a5dfa0-857f-4217-89ff-063a51d64ae1 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813" status: 200 len: 1687 microversion: 2.1 time: 0.809544 Nov 28 06:52:44 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 260/790] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:52:43 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813 => generated 1687 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:52:45 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab422771-7c11-4074-b4a6-d793c790e813", "name": "network-vif-unplugged", "status": "completed", "tag": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418"}, {"server_uuid": "ab422771-7c11-4074-b4a6-d793c790e813", "name": "network-vif-plugged", "status": "completed", "tag": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418"}, {"server_uuid": "ab422771-7c11-4074-b4a6-d793c790e813", "name": "network-vif-deleted", "tag": "5dce38d6-cf1d-4a63-a798-fa9bc36f7418"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:52:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Creating event network-vif-unplugged:5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance ab422771-7c11-4074-b4a6-d793c790e813 on user Nov 28 06:52:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Creating event network-vif-plugged:5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance ab422771-7c11-4074-b4a6-d793c790e813 on user Nov 28 06:52:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] Creating event network-vif-deleted:5dce38d6-cf1d-4a63-a798-fa9bc36f7418 for instance ab422771-7c11-4074-b4a6-d793c790e813 on user Nov 28 06:52:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-ffc82a57-995f-424a-bd75-fa38a198e3b2 req-96349b66-c8d4-4625-a84a-b79ae543ed25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.042888 Nov 28 06:52:45 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 261/791] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:52:45 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa could not be found. Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-50c3f1fb-650f-43d7-ab0c-3679c270f65f tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" status: 404 len: 111 microversion: 2.1 time: 0.035838 Nov 28 06:52:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 271/792] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:52:46 2023] DELETE /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:46 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa could not be found. Nov 28 06:52:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance 46e43d2c-f91b-44cb-9cfe-a0e3682a12aa could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c13f859a-03ce-40eb-b1d9-ca6ed741dfa0 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa" status: 404 len: 111 microversion: 2.1 time: 0.030847 Nov 28 06:52:46 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 261/793] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:52:46 2023] GET /compute/v2.1/servers/46e43d2c-f91b-44cb-9cfe-a0e3682a12aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:46 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:46 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance b30131e3-a805-4fbc-815c-7e379c44a386 could not be found. Nov 28 06:52:46 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance b30131e3-a805-4fbc-815c-7e379c44a386 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-909f4ed2-866d-43ac-80b4-135ae06c8ba8 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386" status: 404 len: 111 microversion: 2.1 time: 0.053337 Nov 28 06:52:46 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 262/794] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:52:46 2023] DELETE /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b30131e3-a805-4fbc-815c-7e379c44a386] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance b30131e3-a805-4fbc-815c-7e379c44a386 could not be found. Nov 28 06:52:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance b30131e3-a805-4fbc-815c-7e379c44a386 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-7137e6e3-8dca-4f20-8716-21f19a00f369 tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386" status: 404 len: 111 microversion: 2.1 time: 0.043728 Nov 28 06:52:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 272/795] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:52:46 2023] GET /compute/v2.1/servers/b30131e3-a805-4fbc-815c-7e379c44a386 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:47 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7", "tag": "64772336-969e-475c-8f13-e208982f0df3"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:52:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:47 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] Creating event network-changed:64772336-969e-475c-8f13-e208982f0df3 for instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 on user Nov 28 06:52:47 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-e22e4d51-9b3b-4a7a-907f-3d332b6b6edc req-e18f58bb-38b9-4493-82d9-4a4e483d49aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045229 Nov 28 06:52:47 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 262/796] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:52:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7", "name": "network-vif-plugged", "status": "completed", "tag": "64772336-969e-475c-8f13-e208982f0df3"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:52:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] Creating event network-vif-plugged:64772336-969e-475c-8f13-e208982f0df3 for instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 on user Nov 28 06:52:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-d4c5d882-8ba4-46b1-b42d-120f3a3ee2f6 req-5efd03a0-b83c-4ec6-a186-345abe6c2f4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031647 Nov 28 06:52:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 263/797] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:52:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:49 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance b4802806-6422-46da-8d0f-5674af0a8433 could not be found. Nov 28 06:52:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance b4802806-6422-46da-8d0f-5674af0a8433 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-0a08d53c-59e5-40bc-983b-93b7fb7f2e5c tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433" status: 404 len: 111 microversion: 2.1 time: 0.033225 Nov 28 06:52:49 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 273/798] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:52:49 2023] DELETE /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:49 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:49 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] [instance: b4802806-6422-46da-8d0f-5674af0a8433] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:52:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:49 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] HTTP exception thrown: Instance b4802806-6422-46da-8d0f-5674af0a8433 could not be found. Nov 28 06:52:49 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] Returning 404 to user: Instance b4802806-6422-46da-8d0f-5674af0a8433 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:52:49 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c6f57b23-e65e-47f5-a284-38bab0f859df tempest-AttachVolumeNegativeTest-538884229 tempest-AttachVolumeNegativeTest-538884229-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433" status: 404 len: 111 microversion: 2.1 time: 0.034760 Nov 28 06:52:49 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 263/799] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:52:49 2023] GET /compute/v2.1/servers/b4802806-6422-46da-8d0f-5674af0a8433 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:52:51 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7", "name": "network-vif-plugged", "status": "completed", "tag": "64772336-969e-475c-8f13-e208982f0df3"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:52:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:52:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:52:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:52:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] Creating event network-vif-plugged:64772336-969e-475c-8f13-e208982f0df3 for instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 on user Nov 28 06:52:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-918032d6-506e-4c67-aff6-3b2e49844104 req-34537063-fd9d-4afd-9445-f62a186f7297 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034260 Nov 28 06:52:51 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 264/800] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:52:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-59bfc8f2-4211-42a7-ab90-06e75d04ca87 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Action: 'create', calling method: .version_select at 0x7f0b0375e170>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-71831858", "metadata": {"Type": "work"}}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:52:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-59bfc8f2-4211-42a7-ab90-06e75d04ca87 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.577823 Nov 28 06:52:55 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 274/801] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 06:52:54 2023] POST /compute/v2.1/os-volumes => generated 351 bytes in 580 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 28 06:52:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6186afd4-9e2e-4db2-afef-f520c006025d tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Calling method '.version_select at 0x7f0b03ceeef0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6186afd4-9e2e-4db2-afef-f520c006025d tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf" status: 200 len: 351 microversion: 2.1 time: 0.074814 Nov 28 06:52:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 264/802] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:52:55 2023] GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:56 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:56 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:52:56 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5c8be37b-fe3e-4e44-a102-d5f4b8c3fb87 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Calling method '.version_select at 0x7f0b03addd80>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5c8be37b-fe3e-4e44-a102-d5f4b8c3fb87 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf" status: 200 len: 351 microversion: 2.1 time: 0.069347 Nov 28 06:52:56 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 265/803] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:52:56 2023] GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf => generated 351 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5b7a5db2-5d38-4033-be97-cc5deea43fe6 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Calling method '.version_select at 0x7f0b036a2680>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-5b7a5db2-5d38-4033-be97-cc5deea43fe6 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf" status: 200 len: 352 microversion: 2.1 time: 0.063950 Nov 28 06:52:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 275/804] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:52:57 2023] GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-1b7abfd1-d8fb-49c8-9512-4aea0385940c tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Calling method '.version_select at 0x7f0b037f91b0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-1b7abfd1-d8fb-49c8-9512-4aea0385940c tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf" status: 200 len: 352 microversion: 2.1 time: 0.051095 Nov 28 06:52:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 265/805] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:52:57 2023] GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:52:57 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-200ef260-e645-4fad-91da-f7a97b1a4bf7 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Calling method '.version_select at 0x7f0b03be0ca0>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:57 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-200ef260-e645-4fad-91da-f7a97b1a4bf7 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf" status: 202 len: 0 microversion: 2.1 time: 0.073143 Nov 28 06:52:57 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 266/806] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:52:57 2023] DELETE /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:52:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-065d8637-6b3e-4869-b122-6163abf61acc tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Calling method '.version_select at 0x7f0b03d100d0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-065d8637-6b3e-4869-b122-6163abf61acc tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf" status: 200 len: 351 microversion: 2.1 time: 0.058170 Nov 28 06:52:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 276/807] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:52:57 2023] GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:52:58 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a9d455e8-d2ca-4d6f-8837-25bcf6343f21 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Calling method '.version_select at 0x7f0b036a80d0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:52:59 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a9d455e8-d2ca-4d6f-8837-25bcf6343f21 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf" status: 200 len: 351 microversion: 2.1 time: 0.061527 Nov 28 06:52:59 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 266/808] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:52:58 2023] GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:00 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9f8e4b3b-0c69-4e52-845b-2d7bf1c3db4e tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Calling method '.version_select at 0x7f0b0396ed40>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9f8e4b3b-0c69-4e52-845b-2d7bf1c3db4e tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf" status: 200 len: 351 microversion: 2.1 time: 0.081012 Nov 28 06:53:00 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 267/809] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:53:00 2023] GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:01 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:01 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:01 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c75e7780-0c28-4454-bd8c-c1223864db74 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Calling method '.version_select at 0x7f0b036a35b0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:01 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-c75e7780-0c28-4454-bd8c-c1223864db74 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] HTTP exception thrown: Volume e406eefe-0b11-4806-a02f-dfe488c31ecf could not be found. Nov 28 06:53:01 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c75e7780-0c28-4454-bd8c-c1223864db74 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] Returning 404 to user: Volume e406eefe-0b11-4806-a02f-dfe488c31ecf could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:53:01 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-c75e7780-0c28-4454-bd8c-c1223864db74 tempest-VolumesGetTestJSON-2123388914 tempest-VolumesGetTestJSON-2123388914-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf" status: 404 len: 109 microversion: 2.1 time: 0.042836 Nov 28 06:53:01 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 277/810] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 06:53:01 2023] GET /compute/v2.1/os-volumes/e406eefe-0b11-4806-a02f-dfe488c31ecf => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 30c7dc1e-9569-49f5-aabf-a98cba6470fa] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=18 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=36 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] HTTP exception thrown: Instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa could not be found. Nov 28 06:53:04 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Returning 404 to user: Instance 30c7dc1e-9569-49f5-aabf-a98cba6470fa could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:53:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-683dacee-3227-42d9-8833-9c62aae26872 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa" status: 404 len: 111 microversion: 2.1 time: 0.037169 Nov 28 06:53:04 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 267/811] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:53:04 2023] GET /compute/v2.1/servers/30c7dc1e-9569-49f5-aabf-a98cba6470fa => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:53:04 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:04 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=16 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:04 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-26dfbdfb-61a7-4a8e-91a2-8a0cb8e4221c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '.version_select at 0x7f0b03dedcf0>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-26dfbdfb-61a7-4a8e-91a2-8a0cb8e4221c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940347240" status: 202 len: 0 microversion: 2.1 time: 0.032104 Nov 28 06:53:04 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 268/812] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 06:53:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940347240 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:53:05 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-145dda3e-1335-48ce-b3e2-5a496af5b023 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:05 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-145dda3e-1335-48ce-b3e2-5a496af5b023 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-145dda3e-1335-48ce-b3e2-5a496af5b023 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-145dda3e-1335-48ce-b3e2-5a496af5b023 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-145dda3e-1335-48ce-b3e2-5a496af5b023 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-145dda3e-1335-48ce-b3e2-5a496af5b023 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-145dda3e-1335-48ce-b3e2-5a496af5b023 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-145dda3e-1335-48ce-b3e2-5a496af5b023 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:05 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-145dda3e-1335-48ce-b3e2-5a496af5b023 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:05 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-145dda3e-1335-48ce-b3e2-5a496af5b023 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1658 microversion: 2.1 time: 0.366835 Nov 28 06:53:05 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 278/813] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:53:05 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1658 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:53:05 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6fa7b7db-d030-4303-9cd4-53d9ff8ce42b tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:05 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6fa7b7db-d030-4303-9cd4-53d9ff8ce42b tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6fa7b7db-d030-4303-9cd4-53d9ff8ce42b tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6fa7b7db-d030-4303-9cd4-53d9ff8ce42b tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6fa7b7db-d030-4303-9cd4-53d9ff8ce42b tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6fa7b7db-d030-4303-9cd4-53d9ff8ce42b tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6fa7b7db-d030-4303-9cd4-53d9ff8ce42b tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6fa7b7db-d030-4303-9cd4-53d9ff8ce42b tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:06 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-6fa7b7db-d030-4303-9cd4-53d9ff8ce42b tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6fa7b7db-d030-4303-9cd4-53d9ff8ce42b tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1658 microversion: 2.1 time: 0.379912 Nov 28 06:53:06 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 268/814] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:53:05 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1658 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:53:06 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-a924f31e-6398-4e3c-94e0-7d2d46ca8347 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:06 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-a924f31e-6398-4e3c-94e0-7d2d46ca8347 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a924f31e-6398-4e3c-94e0-7d2d46ca8347 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a924f31e-6398-4e3c-94e0-7d2d46ca8347 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a924f31e-6398-4e3c-94e0-7d2d46ca8347 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a924f31e-6398-4e3c-94e0-7d2d46ca8347 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a924f31e-6398-4e3c-94e0-7d2d46ca8347 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a924f31e-6398-4e3c-94e0-7d2d46ca8347 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:06 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-a924f31e-6398-4e3c-94e0-7d2d46ca8347 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:06 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-a924f31e-6398-4e3c-94e0-7d2d46ca8347 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1658 microversion: 2.1 time: 0.265199 Nov 28 06:53:06 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 269/815] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:53:06 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1658 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:53:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a0429848-769a-485f-a1c3-1839fd37ecbc tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:17 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a0429848-769a-485f-a1c3-1839fd37ecbc tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:17 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:17 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a0429848-769a-485f-a1c3-1839fd37ecbc tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a0429848-769a-485f-a1c3-1839fd37ecbc tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a0429848-769a-485f-a1c3-1839fd37ecbc tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a0429848-769a-485f-a1c3-1839fd37ecbc tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a0429848-769a-485f-a1c3-1839fd37ecbc tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a0429848-769a-485f-a1c3-1839fd37ecbc tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:17 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a0429848-769a-485f-a1c3-1839fd37ecbc tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.389655 Nov 28 06:53:17 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 279/816] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 06:53:17 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-interface => generated 282 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:53:18 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:18 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=8 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:18 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] Creating event network-changed:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:53:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-2233f2cb-811b-4c7b-a08c-ab6a88fccd2e req-8b01f2af-7982-476f-be8d-1f4c7d5a19f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041396 Nov 28 06:53:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 269/817] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:18 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:18 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-afb91904-820e-4d33-8fb4-b4082e7cc7b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:18 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-afb91904-820e-4d33-8fb4-b4082e7cc7b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-afb91904-820e-4d33-8fb4-b4082e7cc7b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-afb91904-820e-4d33-8fb4-b4082e7cc7b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-afb91904-820e-4d33-8fb4-b4082e7cc7b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-afb91904-820e-4d33-8fb4-b4082e7cc7b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-afb91904-820e-4d33-8fb4-b4082e7cc7b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-afb91904-820e-4d33-8fb4-b4082e7cc7b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:19 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-afb91904-820e-4d33-8fb4-b4082e7cc7b7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/ips" status: 200 len: 109 microversion: 2.20 time: 0.047001 Nov 28 06:53:19 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 270/818] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 28 06:53:18 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/ips => generated 109 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:53:19 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1227503680", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "b822def6-f451-4dbb-938f-da41df56c19b"}]}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:19 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] validate_networks() for [('b822def6-f451-4dbb-938f-da41df56c19b', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Getting quotas for project 5f780d5cb4154beb808bf1232426586b. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Getting quotas for user 62687690bcc64588ab57d9ca8b6ea5ec and project 5f780d5cb4154beb808bf1232426586b. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:53:20 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:53:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1e2573fa-b99f-446f-821b-ec018f533da6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.788180 Nov 28 06:53:20 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 280/819] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:53:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:53:20 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e45f27e9-a116-41d6-b0a4-04f5ddde55b6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:20 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e45f27e9-a116-41d6-b0a4-04f5ddde55b6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:20 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-e45f27e9-a116-41d6-b0a4-04f5ddde55b6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62687690bcc64588ab57d9ca8b6ea5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f780d5cb4154beb808bf1232426586b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e45f27e9-a116-41d6-b0a4-04f5ddde55b6 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d29505be-335a-4f7c-908c-324750c31205" status: 200 len: 1206 microversion: 2.1 time: 0.127436 Nov 28 06:53:20 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 270/820] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:53:20 2023] GET /compute/v2.1/servers/d29505be-335a-4f7c-908c-324750c31205 => generated 1206 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:53:21 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:21 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:21 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'flavor' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:53:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-94ecb782-53a0-4369-be16-316830f84964 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/action" status: 202 len: 0 microversion: 2.20 time: 1.139321 Nov 28 06:53:22 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 271/821] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 06:53:21 2023] POST /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/action => generated 0 bytes in 1142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:53:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:22 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:23 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29505be-335a-4f7c-908c-324750c31205", "tag": "9beb1c6e-fc84-48f9-948e-aead3886696b"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] Creating event network-changed:9beb1c6e-fc84-48f9-948e-aead3886696b for instance d29505be-335a-4f7c-908c-324750c31205 on user Nov 28 06:53:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-565e439b-206b-4128-bfc1-333214f8cbca req-1ee97872-8fe7-4c33-9834-4c610ed51fbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032203 Nov 28 06:53:23 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 271/822] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:23 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:23 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:23 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:23 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-03b64798-80b4-436b-93d5-f04cba0bb97d tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 200 len: 1707 microversion: 2.20 time: 0.290761 Nov 28 06:53:23 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 281/823] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:53:22 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 1707 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:53:25 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-unplugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}, {"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-plugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Creating event network-vif-unplugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:53:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] Creating event network-vif-plugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:53:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-41a72d4d-5a50-4a78-b40d-24a664dc395f req-c34becb0-fa79-46be-bb58-981bf30e0bb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031883 Nov 28 06:53:25 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 272/824] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:25 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:25 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29505be-335a-4f7c-908c-324750c31205", "name": "network-vif-plugged", "status": "completed", "tag": "9beb1c6e-fc84-48f9-948e-aead3886696b"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:25 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:25 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] Creating event network-vif-plugged:9beb1c6e-fc84-48f9-948e-aead3886696b for instance d29505be-335a-4f7c-908c-324750c31205 on user Nov 28 06:53:25 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-d15ae162-ccef-48d1-94a9-ef372f5265b3 req-b4cdb4c1-5864-4fad-a1aa-e888058fa795 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045236 Nov 28 06:53:25 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 272/825] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29505be-335a-4f7c-908c-324750c31205", "name": "network-vif-plugged", "status": "completed", "tag": "9beb1c6e-fc84-48f9-948e-aead3886696b"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] Creating event network-vif-plugged:9beb1c6e-fc84-48f9-948e-aead3886696b for instance d29505be-335a-4f7c-908c-324750c31205 on user Nov 28 06:53:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-a2e23310-f2de-4ecf-8051-792aec41c20b req-e94290d5-e041-4af4-b196-98e0b1582807 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031438 Nov 28 06:53:27 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 282/826] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:29 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] Creating event network-changed:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:53:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-d605b002-7f91-4122-924e-e5a2df734ba1 req-fe3898d0-8bf4-41af-9496-e5ea1974111f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061251 Nov 28 06:53:29 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 273/827] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b83c03c9-e02e-4221-a38b-0409b65c263a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-b83c03c9-e02e-4221-a38b-0409b65c263a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b83c03c9-e02e-4221-a38b-0409b65c263a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b83c03c9-e02e-4221-a38b-0409b65c263a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b83c03c9-e02e-4221-a38b-0409b65c263a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b83c03c9-e02e-4221-a38b-0409b65c263a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b83c03c9-e02e-4221-a38b-0409b65c263a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b83c03c9-e02e-4221-a38b-0409b65c263a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b83c03c9-e02e-4221-a38b-0409b65c263a tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047069 Nov 28 06:53:32 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 273/828] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:53:32 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:32 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:53:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-9b044405-9e15-48cd-8c6c-c9adff247acf tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a" status: 204 len: 0 microversion: 2.1 time: 0.127828 Nov 28 06:53:32 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 283/829] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:53:32 2023] DELETE /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:53:32 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c30a8c77-5e07-4d1a-921e-3bed143f3ab3 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:32 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-c30a8c77-5e07-4d1a-921e-3bed143f3ab3 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c30a8c77-5e07-4d1a-921e-3bed143f3ab3 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c30a8c77-5e07-4d1a-921e-3bed143f3ab3 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c30a8c77-5e07-4d1a-921e-3bed143f3ab3 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c30a8c77-5e07-4d1a-921e-3bed143f3ab3 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c30a8c77-5e07-4d1a-921e-3bed143f3ab3 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c30a8c77-5e07-4d1a-921e-3bed143f3ab3 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-unplugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] Creating event network-vif-unplugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:53:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-e2d0434a-1b36-4379-b7c0-a6f842e9bde9 req-854a4338-6684-41ec-baca-a2c8eb406e4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040929 Nov 28 06:53:32 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 274/830] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:32 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-c30a8c77-5e07-4d1a-921e-3bed143f3ab3 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:32 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c30a8c77-5e07-4d1a-921e-3bed143f3ab3 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a" status: 200 len: 1675 microversion: 2.1 time: 0.332047 Nov 28 06:53:32 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 274/831] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:53:32 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a => generated 1675 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:53:34 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-7ca0c1ed-18a3-4310-8de9-d986ac59706a req-a9176fbd-11a6-45ba-a71a-c73d29cbb767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-deleted", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7ca0c1ed-18a3-4310-8de9-d986ac59706a req-a9176fbd-11a6-45ba-a71a-c73d29cbb767 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7ca0c1ed-18a3-4310-8de9-d986ac59706a req-a9176fbd-11a6-45ba-a71a-c73d29cbb767 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7ca0c1ed-18a3-4310-8de9-d986ac59706a req-a9176fbd-11a6-45ba-a71a-c73d29cbb767 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-7ca0c1ed-18a3-4310-8de9-d986ac59706a req-a9176fbd-11a6-45ba-a71a-c73d29cbb767 service nova] Creating event network-vif-deleted:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:53:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-7ca0c1ed-18a3-4310-8de9-d986ac59706a req-a9176fbd-11a6-45ba-a71a-c73d29cbb767 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103236 Nov 28 06:53:34 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 284/832] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:34 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-dc7eea8a-211a-402c-a241-b57f33c0a2ae tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:34 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-dc7eea8a-211a-402c-a241-b57f33c0a2ae tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-dc7eea8a-211a-402c-a241-b57f33c0a2ae tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-dc7eea8a-211a-402c-a241-b57f33c0a2ae tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-dc7eea8a-211a-402c-a241-b57f33c0a2ae tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-dc7eea8a-211a-402c-a241-b57f33c0a2ae tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-dc7eea8a-211a-402c-a241-b57f33c0a2ae tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-dc7eea8a-211a-402c-a241-b57f33c0a2ae tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] [instance: ab422771-7c11-4074-b4a6-d793c790e813] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] HTTP exception thrown: Instance ab422771-7c11-4074-b4a6-d793c790e813 could not be found. Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Returning 404 to user: Instance ab422771-7c11-4074-b4a6-d793c790e813 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:53:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-bef5e395-b011-44db-a565-edec45daa057 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813" status: 404 len: 111 microversion: 2.1 time: 0.040725 Nov 28 06:53:34 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 275/833] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:53:34 2023] GET /compute/v2.1/servers/ab422771-7c11-4074-b4a6-d793c790e813 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:53:34 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6e6c9215-07c3-4b1a-ad98-4b871e92cd02 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] Calling method '.version_select at 0x7f0b039acb80>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:34 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-dc7eea8a-211a-402c-a241-b57f33c0a2ae tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2c63a8fe9f4992b7ff2aa75a6c4b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4386d41a22343b185f320b3f90d1a83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:34 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-dc7eea8a-211a-402c-a241-b57f33c0a2ae tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" status: 200 len: 1483 microversion: 2.1 time: 0.218736 Nov 28 06:53:34 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 275/834] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:53:34 2023] GET /compute/v2.1/servers/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 => generated 1483 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:53:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-6e6c9215-07c3-4b1a-ad98-4b871e92cd02 tempest-TestServerVolumeAttachmentScenario-406971450 tempest-TestServerVolumeAttachmentScenario-406971450-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1581719119" status: 202 len: 0 microversion: 2.1 time: 0.024363 Nov 28 06:53:34 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 285/835] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 06:53:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1581719119 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de112cbb-849e-43c1-961a-4457585f2e9a", "name": "network-vif-plugged", "status": "completed", "tag": "05ecf301-f2f8-4953-997c-6855e4f27db7"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] Creating event network-vif-plugged:05ecf301-f2f8-4953-997c-6855e4f27db7 for instance de112cbb-849e-43c1-961a-4457585f2e9a on user Nov 28 06:53:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-dad19cca-6005-4dd9-8b49-79f416a707d9 req-1b809850-1315-45b4-9367-6b7fc7ea81fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040860 Nov 28 06:53:34 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 276/836] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:35 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:35 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:35 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:35 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-da81e7cb-763f-41b0-9b78-9c2513d83064 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895/action" status: 202 len: 0 microversion: 2.87 time: 0.073329 Nov 28 06:53:35 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 276/837] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 06:53:35 2023] POST /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:53:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:35 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:36 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:36 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:36 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:36 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-2a18bd86-63b5-4eb0-b8db-00f3806fbb96 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895" status: 200 len: 1763 microversion: 2.87 time: 0.303441 Nov 28 06:53:36 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 286/838] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:53:35 2023] GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895 => generated 1763 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:53:36 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-unplugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:36 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:36 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] Creating event network-vif-unplugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:53:36 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-373ae359-5e5c-4001-8b19-a76d0c941d29 req-89b39dbb-386a-468c-9929-c13bbe19a3b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058038 Nov 28 06:53:36 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 277/839] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:38 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:38 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Going to try to start instance {{(pid=64871) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 28 06:53:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}, {"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-0dc430f9-84c9-4e53-a11f-d18c5fef7d85 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/action" status: 202 len: 0 microversion: 2.1 time: 0.075547 Nov 28 06:53:38 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 277/840] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:53:38 2023] POST /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:53:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6474cc15-3d7a-41e3-bdcb-9eb16d1ff4bf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:53:38 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6474cc15-3d7a-41e3-bdcb-9eb16d1ff4bf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:53:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6474cc15-3d7a-41e3-bdcb-9eb16d1ff4bf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6474cc15-3d7a-41e3-bdcb-9eb16d1ff4bf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:53:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6474cc15-3d7a-41e3-bdcb-9eb16d1ff4bf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:53:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6474cc15-3d7a-41e3-bdcb-9eb16d1ff4bf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6474cc15-3d7a-41e3-bdcb-9eb16d1ff4bf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6474cc15-3d7a-41e3-bdcb-9eb16d1ff4bf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-21af883d-30fe-4826-bc7c-deb326f61292 req-c17a1717-f94a-4d86-9dc5-33c01a3c686a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049398 Nov 28 06:53:38 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 287/841] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:39 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-6474cc15-3d7a-41e3-bdcb-9eb16d1ff4bf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:53:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6474cc15-3d7a-41e3-bdcb-9eb16d1ff4bf tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1649 microversion: 2.1 time: 0.340915 Nov 28 06:53:39 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 278/842] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:53:38 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1649 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:53:40 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:53:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-dc9c3a51-d57e-45f9-8ccc-ff97d7d94c96 req-3303aab7-a5e5-41b8-94f3-84ca25bd83bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037131 Nov 28 06:53:40 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 278/843] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:42 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-plugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] Creating event network-vif-plugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:53:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-a51c4ded-7051-40ee-843c-64107fb52cdf req-d5546e77-b059-4a4e-89ea-46a6a2825df3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075528 Nov 28 06:53:42 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 288/844] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:53:44 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-plugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:53:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:53:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:53:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:53:44 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] Creating event network-vif-plugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:53:44 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-48de83cd-58f1-49bc-aaf3-aa5cac469213 req-19052e19-f18e-493f-a960-13dcf03d57d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042181 Nov 28 06:53:44 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 279/845] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:53:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=22 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8de94572-8a40-4290-8f86-8a8c77e2c109 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8de94572-8a40-4290-8f86-8a8c77e2c109 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8de94572-8a40-4290-8f86-8a8c77e2c109 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8de94572-8a40-4290-8f86-8a8c77e2c109 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8de94572-8a40-4290-8f86-8a8c77e2c109 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8de94572-8a40-4290-8f86-8a8c77e2c109 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8de94572-8a40-4290-8f86-8a8c77e2c109 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8de94572-8a40-4290-8f86-8a8c77e2c109 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:10 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-8de94572-8a40-4290-8f86-8a8c77e2c109 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62687690bcc64588ab57d9ca8b6ea5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f780d5cb4154beb808bf1232426586b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:10 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8de94572-8a40-4290-8f86-8a8c77e2c109 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d29505be-335a-4f7c-908c-324750c31205" status: 200 len: 1483 microversion: 2.1 time: 0.218546 Nov 28 06:54:10 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 279/846] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:54:10 2023] GET /compute/v2.1/servers/d29505be-335a-4f7c-908c-324750c31205 => generated 1483 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:54:11 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-1276738302", "imageRef": "", "flavorRef": "1", "networks": [{"uuid": "7ded7b1e-cfba-4af0-9866-0a4d18198920"}], "security_groups": [{"name": "tempest-securitygroup--664585304"}], "key_name": "tempest-keypair-695255668", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "4c9f5caf-7a60-4516-a4f2-a928bca26534", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:54:11 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:11 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:11 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] validate_networks() for [('7ded7b1e-cfba-4af0-9866-0a4d18198920', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for user b7b9a26798e14399ac1a70568432485e and project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:54:12 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c9f5caf-7a60-4516-a4f2-a928bca26534',volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:54:12 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-c51c5077-8e72-4668-a7fa-91aa2f99a3f5 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.116205 Nov 28 06:54:12 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 289/847] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:54:11 2023] POST /compute/v2.1/servers => generated 403 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:54:12 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=20 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:12 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ccd7f14a-0e96-4d3a-9f62-efed5dbf6af9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:12 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-ccd7f14a-0e96-4d3a-9f62-efed5dbf6af9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:54:12 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-ccd7f14a-0e96-4d3a-9f62-efed5dbf6af9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-ccd7f14a-0e96-4d3a-9f62-efed5dbf6af9 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 200 len: 1075 microversion: 2.1 time: 0.113443 Nov 28 06:54:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 280/848] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:54:12 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 1075 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:13 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-410fca1a-d7e6-4856-948f-8c61ffd4e644 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 200 len: 1648 microversion: 2.20 time: 0.196688 Nov 28 06:54:13 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 280/849] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:54:13 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 1648 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:54:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:54:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] Creating event network-changed:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 06:54:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-e95b2970-0c38-41c6-a55d-8e55d954e896 req-439d606f-fce8-4bba-8e3d-d2cb5a313dd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035034 Nov 28 06:54:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 290/850] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:54:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: de112cbb-849e-43c1-961a-4457585f2e9a] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] HTTP exception thrown: Instance de112cbb-849e-43c1-961a-4457585f2e9a could not be found. Nov 28 06:54:23 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Returning 404 to user: Instance de112cbb-849e-43c1-961a-4457585f2e9a could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:54:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c6c4dd35-e1ee-4139-958a-d3e7da2154bd tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a" status: 404 len: 111 microversion: 2.1 time: 0.206120 Nov 28 06:54:23 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 281/851] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:54:23 2023] GET /compute/v2.1/servers/de112cbb-849e-43c1-961a-4457585f2e9a => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:54:23 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9dac2c34-1c4c-493f-a850-bfc77bec6a62 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '.version_select at 0x7f0b03d2e710>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9dac2c34-1c4c-493f-a850-bfc77bec6a62 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000231521" status: 202 len: 0 microversion: 2.1 time: 0.022696 Nov 28 06:54:23 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 281/852] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 06:54:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000231521 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:54:23 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:23 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:23 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "name": "network-vif-plugged", "status": "completed", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:54:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:23 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] Creating event network-vif-plugged:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 06:54:24 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-7677b93e-f5c7-4a75-8a5d-824d73737bd3 req-346a81e4-b534-41b6-b6f5-22022c59ebb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044494 Nov 28 06:54:24 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 291/853] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:54:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:54:26 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "name": "network-vif-plugged", "status": "completed", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:54:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:26 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] Creating event network-vif-plugged:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 06:54:26 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-56c7f03b-5739-459b-8b47-692f2e56fa9a req-3ffba1d0-e364-4eb8-882b-92db7186d2e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029642 Nov 28 06:54:26 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 282/854] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:54:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=12 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:26 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:26 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e155965d-4f03-4981-8309-07481ba5fc13 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895" status: 200 len: 1769 microversion: 2.87 time: 0.236760 Nov 28 06:54:26 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 282/855] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:54:26 2023] GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895 => generated 1769 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:54:29 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b1c4f3e2-3a6a-4f43-b4e6-820859629595 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:29 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-b1c4f3e2-3a6a-4f43-b4e6-820859629595 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:54:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b1c4f3e2-3a6a-4f43-b4e6-820859629595 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b1c4f3e2-3a6a-4f43-b4e6-820859629595 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b1c4f3e2-3a6a-4f43-b4e6-820859629595 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b1c4f3e2-3a6a-4f43-b4e6-820859629595 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b1c4f3e2-3a6a-4f43-b4e6-820859629595 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b1c4f3e2-3a6a-4f43-b4e6-820859629595 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:29 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-b1c4f3e2-3a6a-4f43-b4e6-820859629595 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:29 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b1c4f3e2-3a6a-4f43-b4e6-820859629595 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1653 microversion: 2.1 time: 0.331201 Nov 28 06:54:29 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 292/856] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:54:29 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1653 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 06:54:31 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:31 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:54:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:31 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:54:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-30627c7e-dc04-4e1a-9acc-2241b7fd81d9 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7" status: 204 len: 0 microversion: 2.1 time: 0.128914 Nov 28 06:54:31 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 283/857] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:54:31 2023] DELETE /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:54:31 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-9780b5ac-0dac-455a-888d-38c8d5ae3dd8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:31 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-9780b5ac-0dac-455a-888d-38c8d5ae3dd8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:54:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9780b5ac-0dac-455a-888d-38c8d5ae3dd8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9780b5ac-0dac-455a-888d-38c8d5ae3dd8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9780b5ac-0dac-455a-888d-38c8d5ae3dd8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9780b5ac-0dac-455a-888d-38c8d5ae3dd8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9780b5ac-0dac-455a-888d-38c8d5ae3dd8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-9780b5ac-0dac-455a-888d-38c8d5ae3dd8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:32 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-9780b5ac-0dac-455a-888d-38c8d5ae3dd8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-9780b5ac-0dac-455a-888d-38c8d5ae3dd8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7" status: 200 len: 1492 microversion: 2.1 time: 0.225249 Nov 28 06:54:32 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 283/858] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:54:31 2023] GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7 => generated 1492 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:54:32 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a8f46d-3105-4486-a8b4-1409c9c544c7", "name": "network-vif-unplugged", "status": "completed", "tag": "ac8aece2-e749-4b38-8812-e9d4df591f41"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:54:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] Creating event network-vif-unplugged:ac8aece2-e749-4b38-8812-e9d4df591f41 for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 on user Nov 28 06:54:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-619e46ce-6be3-411c-a991-e27efabab82c req-9714473f-b839-4e9b-b645-72d596db0205 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037409 Nov 28 06:54:32 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 293/859] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:54:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:54:33 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-32b4b06d-02de-4168-8b37-f00057fbb1c3 req-9b869c39-8654-4dc5-9e5f-cdd09c3181c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a8f46d-3105-4486-a8b4-1409c9c544c7", "name": "network-vif-deleted", "tag": "ac8aece2-e749-4b38-8812-e9d4df591f41"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:54:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-32b4b06d-02de-4168-8b37-f00057fbb1c3 req-9b869c39-8654-4dc5-9e5f-cdd09c3181c7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-32b4b06d-02de-4168-8b37-f00057fbb1c3 req-9b869c39-8654-4dc5-9e5f-cdd09c3181c7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-32b4b06d-02de-4168-8b37-f00057fbb1c3 req-9b869c39-8654-4dc5-9e5f-cdd09c3181c7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:33 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-32b4b06d-02de-4168-8b37-f00057fbb1c3 req-9b869c39-8654-4dc5-9e5f-cdd09c3181c7 service nova] Creating event network-vif-deleted:ac8aece2-e749-4b38-8812-e9d4df591f41 for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 on user Nov 28 06:54:33 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-32b4b06d-02de-4168-8b37-f00057fbb1c3 req-9b869c39-8654-4dc5-9e5f-cdd09c3181c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031153 Nov 28 06:54:33 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 284/860] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:54:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:54:34 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a8f46d-3105-4486-a8b4-1409c9c544c7", "name": "network-vif-plugged", "status": "completed", "tag": "ac8aece2-e749-4b38-8812-e9d4df591f41"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:54:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:34 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:34 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] Creating event network-vif-plugged:ac8aece2-e749-4b38-8812-e9d4df591f41 for instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 on user Nov 28 06:54:34 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-ab2864b2-696e-4910-af42-54a545d00677 req-8f38abdf-4af0-437f-93ca-94c9b927450c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033025 Nov 28 06:54:34 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 284/861] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:54:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:54:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:35 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:54:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:35 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:54:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-0fddbecb-65e3-4c54-b301-4ac482e5f695 tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" status: 204 len: 0 microversion: 2.1 time: 0.109477 Nov 28 06:54:35 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 294/862] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:54:35 2023] DELETE /compute/v2.1/servers/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:54:35 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-4cc65a2f-dcf0-4dd4-8f33-50fb1695fc4d tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:54:35 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-4cc65a2f-dcf0-4dd4-8f33-50fb1695fc4d tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:54:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4cc65a2f-dcf0-4dd4-8f33-50fb1695fc4d tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4cc65a2f-dcf0-4dd4-8f33-50fb1695fc4d tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4cc65a2f-dcf0-4dd4-8f33-50fb1695fc4d tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4cc65a2f-dcf0-4dd4-8f33-50fb1695fc4d tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4cc65a2f-dcf0-4dd4-8f33-50fb1695fc4d tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4cc65a2f-dcf0-4dd4-8f33-50fb1695fc4d tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:35 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-4cc65a2f-dcf0-4dd4-8f33-50fb1695fc4d tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2c63a8fe9f4992b7ff2aa75a6c4b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4386d41a22343b185f320b3f90d1a83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:54:35 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-4cc65a2f-dcf0-4dd4-8f33-50fb1695fc4d tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" status: 200 len: 1489 microversion: 2.1 time: 0.355970 Nov 28 06:54:35 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 285/863] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:54:35 2023] GET /compute/v2.1/servers/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 => generated 1489 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:54:36 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7", "name": "network-vif-unplugged", "status": "completed", "tag": "64772336-969e-475c-8f13-e208982f0df3"}, {"server_uuid": "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7", "name": "network-vif-plugged", "status": "completed", "tag": "64772336-969e-475c-8f13-e208982f0df3"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:54:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:36 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Creating event network-vif-unplugged:64772336-969e-475c-8f13-e208982f0df3 for instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 on user Nov 28 06:54:36 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] Creating event network-vif-plugged:64772336-969e-475c-8f13-e208982f0df3 for instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 on user Nov 28 06:54:36 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-977c33f3-cfab-47cc-8186-73bda04e0c56 req-290192f7-b20a-4b0c-acfc-7dfafc8af5aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036785 Nov 28 06:54:36 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 285/864] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:54:36 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:54:36 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-34d04521-0069-4cef-bab8-1894236c4977 req-018a1499-157a-426c-b856-c3b4a0e9eab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9822ce-81f4-4988-a8c7-d65aa3d7dec7", "name": "network-vif-deleted", "tag": "64772336-969e-475c-8f13-e208982f0df3"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:54:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-34d04521-0069-4cef-bab8-1894236c4977 req-018a1499-157a-426c-b856-c3b4a0e9eab3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:54:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-34d04521-0069-4cef-bab8-1894236c4977 req-018a1499-157a-426c-b856-c3b4a0e9eab3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:54:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-34d04521-0069-4cef-bab8-1894236c4977 req-018a1499-157a-426c-b856-c3b4a0e9eab3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:54:36 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-34d04521-0069-4cef-bab8-1894236c4977 req-018a1499-157a-426c-b856-c3b4a0e9eab3 service nova] Creating event network-vif-deleted:64772336-969e-475c-8f13-e208982f0df3 for instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 on user Nov 28 06:54:36 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-34d04521-0069-4cef-bab8-1894236c4977 req-018a1499-157a-426c-b856-c3b4a0e9eab3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045901 Nov 28 06:54:36 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 295/865] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:54:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:55:02 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e358981f-2daf-45e3-9b46-291900d60527 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:02 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e358981f-2daf-45e3-9b46-291900d60527 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:02 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:55:02 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:55:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e358981f-2daf-45e3-9b46-291900d60527 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e358981f-2daf-45e3-9b46-291900d60527 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e358981f-2daf-45e3-9b46-291900d60527 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e358981f-2daf-45e3-9b46-291900d60527 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e358981f-2daf-45e3-9b46-291900d60527 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:02 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e358981f-2daf-45e3-9b46-291900d60527 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:03 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-e358981f-2daf-45e3-9b46-291900d60527 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:55:03 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e358981f-2daf-45e3-9b46-291900d60527 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 200 len: 1429 microversion: 2.1 time: 0.199219 Nov 28 06:55:03 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 286/866] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:55:02 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 1429 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:55:13 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-13a6fa73-6e37-4ff9-b74c-d1a138c76d66 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1afd034-1bbc-43d2-8928-4c42295bcc8a"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:13 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-13a6fa73-6e37-4ff9-b74c-d1a138c76d66 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:13 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:55:13 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=16 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:55:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13a6fa73-6e37-4ff9-b74c-d1a138c76d66 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13a6fa73-6e37-4ff9-b74c-d1a138c76d66 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13a6fa73-6e37-4ff9-b74c-d1a138c76d66 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13a6fa73-6e37-4ff9-b74c-d1a138c76d66 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13a6fa73-6e37-4ff9-b74c-d1a138c76d66 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-13a6fa73-6e37-4ff9-b74c-d1a138c76d66 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-13a6fa73-6e37-4ff9-b74c-d1a138c76d66 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.284585 Nov 28 06:55:13 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 286/867] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 06:55:13 2023] POST /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-volume_attachments => generated 188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:14 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=64872) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 06:55:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d19fea0a-879d-4aca-b496-61c9fad6bf6e tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/action" status: 202 len: 0 microversion: 2.20 time: 0.135166 Nov 28 06:55:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 296/868] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 06:55:14 2023] POST /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:55:14 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:55:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-77ef1631-ea97-4c28-b127-a2f9a120a66b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 200 len: 1734 microversion: 2.20 time: 0.223951 Nov 28 06:55:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 287/869] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:55:14 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:55:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:17 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:17 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:55:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-eca5a8de-8a4d-4a6b-a21c-32a409670530 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d29505be-335a-4f7c-908c-324750c31205" status: 204 len: 0 microversion: 2.1 time: 0.133866 Nov 28 06:55:17 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 287/870] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:55:17 2023] DELETE /compute/v2.1/servers/d29505be-335a-4f7c-908c-324750c31205 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:55:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-8efd97b4-95ea-4746-a1d4-e4a1186294c7 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:17 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-8efd97b4-95ea-4746-a1d4-e4a1186294c7 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8efd97b4-95ea-4746-a1d4-e4a1186294c7 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8efd97b4-95ea-4746-a1d4-e4a1186294c7 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8efd97b4-95ea-4746-a1d4-e4a1186294c7 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8efd97b4-95ea-4746-a1d4-e4a1186294c7 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8efd97b4-95ea-4746-a1d4-e4a1186294c7 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8efd97b4-95ea-4746-a1d4-e4a1186294c7 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29505be-335a-4f7c-908c-324750c31205", "name": "network-vif-unplugged", "status": "completed", "tag": "9beb1c6e-fc84-48f9-948e-aead3886696b"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] Creating event network-vif-unplugged:9beb1c6e-fc84-48f9-948e-aead3886696b for instance d29505be-335a-4f7c-908c-324750c31205 on user Nov 28 06:55:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-6fe926b5-52ce-475b-908b-2bb550582586 req-9a76e44a-5d33-4b39-a9cc-9e76b4777fdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121422 Nov 28 06:55:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 288/871] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:55:17 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-8efd97b4-95ea-4746-a1d4-e4a1186294c7 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62687690bcc64588ab57d9ca8b6ea5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f780d5cb4154beb808bf1232426586b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:55:17 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-8efd97b4-95ea-4746-a1d4-e4a1186294c7 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d29505be-335a-4f7c-908c-324750c31205" status: 200 len: 1489 microversion: 2.1 time: 0.453609 Nov 28 06:55:17 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 297/872] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:55:17 2023] GET /compute/v2.1/servers/d29505be-335a-4f7c-908c-324750c31205 => generated 1489 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:55:18 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-54b9434e-d711-4dd3-b8ee-ecb263707b03 req-d23bae10-3ac1-42f4-ab2d-2933ceffe44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29505be-335a-4f7c-908c-324750c31205", "name": "network-vif-deleted", "tag": "9beb1c6e-fc84-48f9-948e-aead3886696b"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-54b9434e-d711-4dd3-b8ee-ecb263707b03 req-d23bae10-3ac1-42f4-ab2d-2933ceffe44c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-54b9434e-d711-4dd3-b8ee-ecb263707b03 req-d23bae10-3ac1-42f4-ab2d-2933ceffe44c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-54b9434e-d711-4dd3-b8ee-ecb263707b03 req-d23bae10-3ac1-42f4-ab2d-2933ceffe44c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-54b9434e-d711-4dd3-b8ee-ecb263707b03 req-d23bae10-3ac1-42f4-ab2d-2933ceffe44c service nova] Creating event network-vif-deleted:9beb1c6e-fc84-48f9-948e-aead3886696b for instance d29505be-335a-4f7c-908c-324750c31205 on user Nov 28 06:55:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-54b9434e-d711-4dd3-b8ee-ecb263707b03 req-d23bae10-3ac1-42f4-ab2d-2933ceffe44c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032540 Nov 28 06:55:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 288/873] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:55:19 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29505be-335a-4f7c-908c-324750c31205", "name": "network-vif-plugged", "status": "completed", "tag": "9beb1c6e-fc84-48f9-948e-aead3886696b"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:19 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] Creating event network-vif-plugged:9beb1c6e-fc84-48f9-948e-aead3886696b for instance d29505be-335a-4f7c-908c-324750c31205 on user Nov 28 06:55:19 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-cac19fde-a37c-4fbd-9806-136cbf51e687 req-a0160f0e-27fb-4cd2-a263-16f9773b587d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028058 Nov 28 06:55:19 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 289/874] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 94a8f46d-3105-4486-a8b4-1409c9c544c7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] HTTP exception thrown: Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 could not be found. Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Returning 404 to user: Instance 94a8f46d-3105-4486-a8b4-1409c9c544c7 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:55:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-5759fe66-3bc9-4074-868b-da1075075502 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7" status: 404 len: 111 microversion: 2.1 time: 0.029846 Nov 28 06:55:22 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 298/875] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:55:22 2023] GET /compute/v2.1/servers/94a8f46d-3105-4486-a8b4-1409c9c544c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:55:22 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:22 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:22 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:55:22 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-96919928-cb5a-4964-bc69-fb23c2b3efac tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1" status: 204 len: 0 microversion: 2.1 time: 0.153427 Nov 28 06:55:22 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 289/876] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:55:22 2023] DELETE /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:55:22 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-63409d60-452e-4dcf-bb9a-ad060934e738 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:22 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-63409d60-452e-4dcf-bb9a-ad060934e738 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-63409d60-452e-4dcf-bb9a-ad060934e738 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-63409d60-452e-4dcf-bb9a-ad060934e738 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-63409d60-452e-4dcf-bb9a-ad060934e738 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-63409d60-452e-4dcf-bb9a-ad060934e738 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-63409d60-452e-4dcf-bb9a-ad060934e738 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-63409d60-452e-4dcf-bb9a-ad060934e738 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-unplugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:22 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-63409d60-452e-4dcf-bb9a-ad060934e738 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109001cce8ec4aa0b87f271b415cd5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f90603ba77644568ec6f6fd37689a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:55:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-63409d60-452e-4dcf-bb9a-ad060934e738 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1" status: 200 len: 1508 microversion: 2.1 time: 0.257495 Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:22 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 290/877] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:55:22 2023] GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:55:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] Creating event network-vif-unplugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:55:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-0bdcf399-9d42-4cbf-b0b1-41cdfbc3d82e req-80738f9a-ffde-4384-bbd7-b201120a0d7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046862 Nov 28 06:55:22 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 299/878] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:55:23 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-1b966d4a-35ac-4a7f-993d-37a2e0771918 req-31964eeb-64ae-4b0e-aa2d-8adc63b1a505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-deleted", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-1b966d4a-35ac-4a7f-993d-37a2e0771918 req-31964eeb-64ae-4b0e-aa2d-8adc63b1a505 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-1b966d4a-35ac-4a7f-993d-37a2e0771918 req-31964eeb-64ae-4b0e-aa2d-8adc63b1a505 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-1b966d4a-35ac-4a7f-993d-37a2e0771918 req-31964eeb-64ae-4b0e-aa2d-8adc63b1a505 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-1b966d4a-35ac-4a7f-993d-37a2e0771918 req-31964eeb-64ae-4b0e-aa2d-8adc63b1a505 service nova] Creating event network-vif-deleted:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:55:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-1b966d4a-35ac-4a7f-993d-37a2e0771918 req-31964eeb-64ae-4b0e-aa2d-8adc63b1a505 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032979 Nov 28 06:55:23 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 290/879] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:55:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37549ec7-6ded-412f-8a4f-58a7469e4cd1", "name": "network-vif-plugged", "status": "completed", "tag": "63ce66df-1214-4fbb-a8f5-8d08c9fb640f"}, {"name": "network-changed", "server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Creating event network-vif-plugged:63ce66df-1214-4fbb-a8f5-8d08c9fb640f for instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 on user Nov 28 06:55:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] Creating event network-changed:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:55:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-d31e8c71-fd4f-4a90-80cc-63761e5c706f req-1f7b2098-3fdd-431b-9dbc-942741c76b91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034245 Nov 28 06:55:24 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 291/880] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:24 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:55:26 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:26 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] [instance: 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:26 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] HTTP exception thrown: Instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 could not be found. Nov 28 06:55:26 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] Returning 404 to user: Instance 9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:55:26 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e4373a1a-5053-4b54-a233-14f790e1ea4b tempest-VolumesActionsTest-1371009149 tempest-VolumesActionsTest-1371009149-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7" status: 404 len: 111 microversion: 2.1 time: 0.184383 Nov 28 06:55:26 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 300/881] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:55:25 2023] GET /compute/v2.1/servers/9a9822ce-81f4-4988-a8c7-d65aa3d7dec7 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:55:26 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:26 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:26 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:55:26 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8f63c59b-40e8-48a8-a5fb-ccd70a2cccf6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895" status: 204 len: 0 microversion: 2.87 time: 0.220262 Nov 28 06:55:26 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 291/882] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:55:26 2023] DELETE /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:55:26 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:26 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:27 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:55:27 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:55:27 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:55:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-19edcd9d-e76a-4049-a4ca-0d0906a9b4e1 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895" status: 200 len: 1775 microversion: 2.87 time: 0.330662 Nov 28 06:55:27 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 292/883] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:55:26 2023] GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895 => generated 1775 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:55:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-unplugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] Creating event network-vif-unplugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:55:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-8f03889f-de19-45b7-9ba4-6af732519f43 req-de06655e-d589-4660-9401-cf6d3847d2ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039903 Nov 28 06:55:27 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 301/884] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:55:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}, {"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}, {"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}, {"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-unplugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}, {"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-plugged", "status": "completed", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:55:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:55:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:55:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Creating event network-vif-unplugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:55:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] Creating event network-vif-plugged:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:55:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-dc02805d-c914-49a1-b8ff-038f6950d051 req-978cbf53-df31-4cdf-a8b0-9eb72cfa229a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.064240 Nov 28 06:55:29 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 292/885] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:29 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:55:29 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-9962bad7-ce0c-4969-84e1-a66600af3af6 req-3e492275-d76c-4e57-8f5a-5f78fd2298a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a328017-e6a2-4b35-a18d-d51a14e29895", "name": "network-vif-deleted", "tag": "afd5f93d-f360-467a-9e4c-b7816bcd41ae"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9962bad7-ce0c-4969-84e1-a66600af3af6 req-3e492275-d76c-4e57-8f5a-5f78fd2298a3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9962bad7-ce0c-4969-84e1-a66600af3af6 req-3e492275-d76c-4e57-8f5a-5f78fd2298a3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9962bad7-ce0c-4969-84e1-a66600af3af6 req-3e492275-d76c-4e57-8f5a-5f78fd2298a3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-9962bad7-ce0c-4969-84e1-a66600af3af6 req-3e492275-d76c-4e57-8f5a-5f78fd2298a3 service nova] Creating event network-vif-deleted:afd5f93d-f360-467a-9e4c-b7816bcd41ae for instance 3a328017-e6a2-4b35-a18d-d51a14e29895 on user Nov 28 06:55:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-9962bad7-ce0c-4969-84e1-a66600af3af6 req-3e492275-d76c-4e57-8f5a-5f78fd2298a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039338 Nov 28 06:55:29 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 293/886] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:55:29 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c58d1e6e-e9cd-42e5-aaea-85f4a58feacb tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:29 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-c58d1e6e-e9cd-42e5-aaea-85f4a58feacb tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c58d1e6e-e9cd-42e5-aaea-85f4a58feacb tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c58d1e6e-e9cd-42e5-aaea-85f4a58feacb tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c58d1e6e-e9cd-42e5-aaea-85f4a58feacb tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c58d1e6e-e9cd-42e5-aaea-85f4a58feacb tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c58d1e6e-e9cd-42e5-aaea-85f4a58feacb tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c58d1e6e-e9cd-42e5-aaea-85f4a58feacb tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:29 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-c58d1e6e-e9cd-42e5-aaea-85f4a58feacb tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059875 Nov 28 06:55:29 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 302/887] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:55:29 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:55:30 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:30 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:30 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:55:30 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d9d188de-53fa-48d6-a905-5735ace84df5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 204 len: 0 microversion: 2.1 time: 0.217465 Nov 28 06:55:30 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 293/888] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:55:30 2023] DELETE /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:55:30 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-16b040a5-b595-416f-902f-7a89945c926b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:55:30 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-16b040a5-b595-416f-902f-7a89945c926b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:55:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-16b040a5-b595-416f-902f-7a89945c926b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-16b040a5-b595-416f-902f-7a89945c926b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-16b040a5-b595-416f-902f-7a89945c926b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-16b040a5-b595-416f-902f-7a89945c926b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-16b040a5-b595-416f-902f-7a89945c926b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-16b040a5-b595-416f-902f-7a89945c926b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:30 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-16b040a5-b595-416f-902f-7a89945c926b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:55:30 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-16b040a5-b595-416f-902f-7a89945c926b tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 200 len: 1659 microversion: 2.1 time: 0.258924 Nov 28 06:55:30 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 294/889] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:55:30 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 1659 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:55:31 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-unplugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}, {"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-plugged", "status": "completed", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Creating event network-vif-unplugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:55:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] Creating event network-vif-plugged:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:55:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-88f49464-9b33-4e01-8202-f1536f837d6b req-f69c7e5b-bf47-4a2a-a24c-8d52eeefb781 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028772 Nov 28 06:55:31 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 303/890] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:31 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:55:33 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-plugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}, {"server_uuid": "bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d", "name": "network-vif-deleted", "tag": "d20c570c-280d-472a-a11a-3e13c3920461"}, {"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-plugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:55:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:55:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:55:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:55:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Creating event network-vif-plugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:55:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Creating event network-vif-deleted:d20c570c-280d-472a-a11a-3e13c3920461 for instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d on user Nov 28 06:55:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] Creating event network-vif-plugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:55:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-58676124-7ad7-4e2d-bdb9-e5083ddb9481 req-cfaceab8-8410-4e6a-931e-52bb03fd655c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037601 Nov 28 06:55:33 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 294/891] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:03 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1c9c5880-5dc7-4a06-bccc-77f5f6d50415 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:03 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-1c9c5880-5dc7-4a06-bccc-77f5f6d50415 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:03 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=18 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:03 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=32 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1c9c5880-5dc7-4a06-bccc-77f5f6d50415 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1c9c5880-5dc7-4a06-bccc-77f5f6d50415 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1c9c5880-5dc7-4a06-bccc-77f5f6d50415 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1c9c5880-5dc7-4a06-bccc-77f5f6d50415 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1c9c5880-5dc7-4a06-bccc-77f5f6d50415 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1c9c5880-5dc7-4a06-bccc-77f5f6d50415 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:03 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1c9c5880-5dc7-4a06-bccc-77f5f6d50415 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.145389 Nov 28 06:56:03 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 295/892] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:56:03 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad/os-interface => generated 282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e69254a-5914-4e90-ae6e-bdf28ac716e7", "tag": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=7,nova_cell1:UPDATE=12 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-53f8fbc1-20d7-4bb3-a3c5-d8f21ad1e8f2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] Creating event network-changed:29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 on user Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-53f8fbc1-20d7-4bb3-a3c5-d8f21ad1e8f2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-10d5a15d-ed58-4e6e-a0b1-4e02e2ad4e47 req-c9a6f7bc-691c-4b1e-92b9-20286915761e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044634 Nov 28 06:56:04 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 304/893] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f8fbc1-20d7-4bb3-a3c5-d8f21ad1e8f2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f8fbc1-20d7-4bb3-a3c5-d8f21ad1e8f2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f8fbc1-20d7-4bb3-a3c5-d8f21ad1e8f2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f8fbc1-20d7-4bb3-a3c5-d8f21ad1e8f2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f8fbc1-20d7-4bb3-a3c5-d8f21ad1e8f2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f8fbc1-20d7-4bb3-a3c5-d8f21ad1e8f2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:04 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-aa9741e4-66f7-40ce-abc7-4c102ac1d095 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 200 len: 1779 microversion: 2.20 time: 0.209073 Nov 28 06:56:04 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 296/894] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:56:04 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 1779 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:56:04 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-53f8fbc1-20d7-4bb3-a3c5-d8f21ad1e8f2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-53f8fbc1-20d7-4bb3-a3c5-d8f21ad1e8f2 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 200 len: 1429 microversion: 2.1 time: 0.779608 Nov 28 06:56:04 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 295/895] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:56:04 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 1429 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Old instance type m1.tiny, new instance type m1.small {{(pid=64872) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Getting quotas for user b7b9a26798e14399ac1a70568432485e and project ccf9caaf7cab4c0eb3343ea2c2501481. Resources: {'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:56:05 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:56:05 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-193b8eea-67ee-4db7-b255-96c6c980e4c1 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "POST /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad/action" status: 202 len: 0 microversion: 2.1 time: 0.348264 Nov 28 06:56:05 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 305/896] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:56:04 2023] POST /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:56:05 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-4699b7c1-b175-40ed-b7cf-4cd9d9c35868 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:05 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-4699b7c1-b175-40ed-b7cf-4cd9d9c35868 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4699b7c1-b175-40ed-b7cf-4cd9d9c35868 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4699b7c1-b175-40ed-b7cf-4cd9d9c35868 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4699b7c1-b175-40ed-b7cf-4cd9d9c35868 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4699b7c1-b175-40ed-b7cf-4cd9d9c35868 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4699b7c1-b175-40ed-b7cf-4cd9d9c35868 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4699b7c1-b175-40ed-b7cf-4cd9d9c35868 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:05 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-4699b7c1-b175-40ed-b7cf-4cd9d9c35868 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-4699b7c1-b175-40ed-b7cf-4cd9d9c35868 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 200 len: 1438 microversion: 2.1 time: 0.234894 Nov 28 06:56:05 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 297/897] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:56:05 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 1438 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:56:06 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] Creating event network-changed:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 06:56:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-cf4e0f43-5ae2-465f-9675-5b7e1313a763 req-a2555927-2672-4d2c-a186-b002f6dee124 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038292 Nov 28 06:56:06 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 296/898] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:07 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "name": "network-vif-unplugged", "status": "completed", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:07 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] Creating event network-vif-unplugged:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 06:56:07 user devstack@n-api.service[64872]: DEBUG nova.compute.api [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] Instance edb101d9-028e-4191-84a2-1169555a21ad is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:56:07 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-71c99f10-f6b9-4902-b1bb-c7a5d66e7c7d req-8795e8ab-1bbf-4208-a7aa-c8ea3ce74968 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050801 Nov 28 06:56:07 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 306/899] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:08 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] [instance: d29505be-335a-4f7c-908c-324750c31205] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] HTTP exception thrown: Instance d29505be-335a-4f7c-908c-324750c31205 could not be found. Nov 28 06:56:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] Returning 404 to user: Instance d29505be-335a-4f7c-908c-324750c31205 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:56:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-39969520-43a7-4bff-803c-4ff0fbaf5361 tempest-VolumesActionsTest-1817915228 tempest-VolumesActionsTest-1817915228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d29505be-335a-4f7c-908c-324750c31205" status: 404 len: 111 microversion: 2.1 time: 0.029149 Nov 28 06:56:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 298/900] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:56:08 2023] GET /compute/v2.1/servers/d29505be-335a-4f7c-908c-324750c31205 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:56:09 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "name": "network-vif-plugged", "status": "completed", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] Creating event network-vif-plugged:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 06:56:09 user devstack@n-api.service[64871]: DEBUG nova.compute.api [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] Instance edb101d9-028e-4191-84a2-1169555a21ad is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:56:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-af7f8950-62ac-46a6-ad6f-bd0325d67c23 req-c14a7204-6b83-40f3-ae5d-3a5b070ccc46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038644 Nov 28 06:56:09 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 297/901] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:12 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:12 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] [instance: 37549ec7-6ded-412f-8a4f-58a7469e4cd1] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:12 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] HTTP exception thrown: Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 could not be found. Nov 28 06:56:12 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] Returning 404 to user: Instance 37549ec7-6ded-412f-8a4f-58a7469e4cd1 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:56:12 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-9879564e-2fc3-4236-8e29-4e69d3d514b8 tempest-ServerRescueNegativeTestJSON-226827849 tempest-ServerRescueNegativeTestJSON-226827849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1" status: 404 len: 111 microversion: 2.1 time: 0.040544 Nov 28 06:56:12 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 307/902] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:56:12 2023] GET /compute/v2.1/servers/37549ec7-6ded-412f-8a4f-58a7469e4cd1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:56:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:17 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 3a328017-e6a2-4b35-a18d-d51a14e29895] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] HTTP exception thrown: Instance 3a328017-e6a2-4b35-a18d-d51a14e29895 could not be found. Nov 28 06:56:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Returning 404 to user: Instance 3a328017-e6a2-4b35-a18d-d51a14e29895 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:56:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-f5babfbe-fa92-4bed-83f5-50a647029aee tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895" status: 404 len: 111 microversion: 2.87 time: 0.033595 Nov 28 06:56:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 299/903] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:56:17 2023] GET /compute/v2.1/servers/3a328017-e6a2-4b35-a18d-d51a14e29895 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 28 06:56:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:17 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:17 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:56:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-20784e53-8649-49e8-9383-d7a4605d76e6 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8" status: 204 len: 0 microversion: 2.87 time: 0.126735 Nov 28 06:56:17 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 298/904] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:56:17 2023] DELETE /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:56:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:17 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:17 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:17 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:18 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:18 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-79cafe55-2375-4841-aa8c-3777aa940539 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8" status: 200 len: 1697 microversion: 2.87 time: 0.276123 Nov 28 06:56:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 308/905] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:56:17 2023] GET /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8 => generated 1697 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:56:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23537de-fa1e-4cd2-8050-04ef2b911ac8", "name": "network-vif-unplugged", "status": "completed", "tag": "0af514bf-1b38-47e8-97a8-7e1c3d34246a"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] Creating event network-vif-unplugged:0af514bf-1b38-47e8-97a8-7e1c3d34246a for instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 on user Nov 28 06:56:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-071c737b-d455-45de-af15-259cd9f1a1e2 req-15203891-cf71-4b21-86e2-e32db6a8e5fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046676 Nov 28 06:56:18 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 300/906] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:20 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23537de-fa1e-4cd2-8050-04ef2b911ac8", "name": "network-vif-plugged", "status": "completed", "tag": "0af514bf-1b38-47e8-97a8-7e1c3d34246a"}, {"server_uuid": "e23537de-fa1e-4cd2-8050-04ef2b911ac8", "name": "network-vif-deleted", "tag": "0af514bf-1b38-47e8-97a8-7e1c3d34246a"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] Creating event network-vif-plugged:0af514bf-1b38-47e8-97a8-7e1c3d34246a for instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 on user Nov 28 06:56:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] Creating event network-vif-deleted:0af514bf-1b38-47e8-97a8-7e1c3d34246a for instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 on user Nov 28 06:56:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-ca0ec86a-ae99-4846-8b0f-bab910e26410 req-278d956a-8338-49a2-a625-b6a450612edc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037520 Nov 28 06:56:20 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 299/907] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:20 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:20 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] HTTP exception thrown: Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d could not be found. Nov 28 06:56:20 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Returning 404 to user: Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:56:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-6746860b-dced-43f8-a429-cbfc04cffbfd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 404 len: 111 microversion: 2.1 time: 0.034663 Nov 28 06:56:20 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 309/908] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:56:20 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:56:20 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0988781d-e559-4c3c-b8f7-7e4aca701502 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '.version_select at 0x7f0b03adcf70>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0988781d-e559-4c3c-b8f7-7e4aca701502 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-612979215" status: 202 len: 0 microversion: 2.1 time: 0.033056 Nov 28 06:56:20 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 301/909] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 06:56:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-612979215 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:56:21 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b74d1a90-349c-4b21-acb1-989ce3899128 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'create', calling method: .version_select at 0x7f0b036a9510>, body: {"keypair": {"name": "tempest-keypair-34936543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeL1D4XRxzvT/Z60Ib+3FUK5/1PR8cLQz940qRyjWckwR3Q22IKZERaEWQ61+imcHTbDt7QT2R5/EA26wbBSfVguaOQgWpLV4txliTaqKMuQOQdMsadd/OnwheDO3H/5Q=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:21 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-b74d1a90-349c-4b21-acb1-989ce3899128 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting quotas for project 2a4f8529212249d68a54698cffcdc44b. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:56:21 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-b74d1a90-349c-4b21-acb1-989ce3899128 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting quotas for user 63fdd08d34954e97ae65ec1ce1c3d0f6 and project 2a4f8529212249d68a54698cffcdc44b. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:56:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b74d1a90-349c-4b21-acb1-989ce3899128 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.043359 Nov 28 06:56:21 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 300/910] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:56:21 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:56:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "name": "network-vif-plugged", "status": "completed", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}, {"server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "name": "network-vif-plugged", "status": "completed", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Creating event network-vif-plugged:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 06:56:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Creating event network-vif-plugged:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 06:56:22 user devstack@n-api.service[64872]: DEBUG nova.compute.api [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] Instance edb101d9-028e-4191-84a2-1169555a21ad is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 06:56:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-9f28d872-8cce-4e9b-aa98-1f1c5e8f6c80 req-423e74ff-7281-4a99-831f-dcd6382e3df3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051595 Nov 28 06:56:22 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 310/911] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1534702303", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "4674e5d4-7ef8-4582-a62f-45a48e5164b0"}], "security_groups": [{"name": "tempest-securitygroup--1369584183"}], "key_name": "tempest-keypair-34936543", "user_data": "}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] validate_networks() for [('4674e5d4-7ef8-4582-a62f-45a48e5164b0', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting quotas for project 2a4f8529212249d68a54698cffcdc44b. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Getting quotas for user 63fdd08d34954e97ae65ec1ce1c3d0f6 and project 2a4f8529212249d68a54698cffcdc44b. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:56:23 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:56:23 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-23bc89c3-1a63-40c7-ab57-130a779b100e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.804278 Nov 28 06:56:23 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 302/912] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:56:23 2023] POST /compute/v2.1/servers => generated 400 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:56:23 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d3568e4b-a157-40f6-9572-f3f251cee95d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:23 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d3568e4b-a157-40f6-9572-f3f251cee95d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:23 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d3568e4b-a157-40f6-9572-f3f251cee95d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d3568e4b-a157-40f6-9572-f3f251cee95d tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4" status: 200 len: 1228 microversion: 2.1 time: 0.069271 Nov 28 06:56:23 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 301/913] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:56:23 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4 => generated 1228 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1819608978", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "7b571a74-5548-4cb5-9f9f-190fbed2a045", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7d507ecb-7146-47b0-98b6-2939026c2b05"}]}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] validate_networks() for [('7d507ecb-7146-47b0-98b6-2939026c2b05', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for user 2139976b453e4bd2b8e83e551a0cc772 and project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:56:24 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7b571a74-5548-4cb5-9f9f-190fbed2a045',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:56:25 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f72d066a-ede8-40f7-aba0-4844c0a15bcd tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.754305 Nov 28 06:56:25 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 311/914] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:56:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:56:25 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-32f524cb-0f70-4e34-a159-a998c22463f8 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:25 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-32f524cb-0f70-4e34-a159-a998c22463f8 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:25 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-32f524cb-0f70-4e34-a159-a998c22463f8 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-32f524cb-0f70-4e34-a159-a998c22463f8 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0" status: 200 len: 1050 microversion: 2.1 time: 0.076777 Nov 28 06:56:25 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 303/915] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:56:25 2023] GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0 => generated 1050 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:56:27 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e60471-f6da-476c-b0de-c729eec1b2b4", "tag": "97da79b7-c41c-46da-8faa-03d072c630a6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] Creating event network-changed:97da79b7-c41c-46da-8faa-03d072c630a6 for instance 92e60471-f6da-476c-b0de-c729eec1b2b4 on user Nov 28 06:56:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-5dd94a52-a2b5-4519-a905-d50d13c3ba46 req-cc3f30e0-de3b-465b-a1cc-d9cf0616da6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039162 Nov 28 06:56:27 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 302/916] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:56:29 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3a583a-f470-4959-8515-1b1ddfe471c0", "tag": "75d293fb-d78b-480f-a0a9-0f98b3d606e7"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:29 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] Creating event network-changed:75d293fb-d78b-480f-a0a9-0f98b3d606e7 for instance af3a583a-f470-4959-8515-1b1ddfe471c0 on user Nov 28 06:56:29 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-9b3f07ce-fc78-4055-8cac-7ff6bc307f17 req-2381a82e-77c6-4b1d-b0e9-3bbe9707ae2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084376 Nov 28 06:56:29 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 312/917] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:56:30 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e60471-f6da-476c-b0de-c729eec1b2b4", "name": "network-vif-plugged", "status": "completed", "tag": "97da79b7-c41c-46da-8faa-03d072c630a6"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:30 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] Creating event network-vif-plugged:97da79b7-c41c-46da-8faa-03d072c630a6 for instance 92e60471-f6da-476c-b0de-c729eec1b2b4 on user Nov 28 06:56:30 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-60c06ed9-aa6c-4751-980f-21cbadc1dab4 req-7fa8443e-86ee-4b1c-8df2-fb2be4caede5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053876 Nov 28 06:56:30 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 304/918] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:32 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e60471-f6da-476c-b0de-c729eec1b2b4", "name": "network-vif-plugged", "status": "completed", "tag": "97da79b7-c41c-46da-8faa-03d072c630a6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] Creating event network-vif-plugged:97da79b7-c41c-46da-8faa-03d072c630a6 for instance 92e60471-f6da-476c-b0de-c729eec1b2b4 on user Nov 28 06:56:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-7f412f15-579d-4694-a8a7-223ea7548059 req-692718f6-fed6-4c87-bed7-ca62bbc448ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034297 Nov 28 06:56:32 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 303/919] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:47 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3a583a-f470-4959-8515-1b1ddfe471c0", "name": "network-vif-plugged", "status": "completed", "tag": "75d293fb-d78b-480f-a0a9-0f98b3d606e7"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] Creating event network-vif-plugged:75d293fb-d78b-480f-a0a9-0f98b3d606e7 for instance af3a583a-f470-4959-8515-1b1ddfe471c0 on user Nov 28 06:56:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-40f1aea3-7ed6-49d1-bda9-7d43cb98d1ba req-fe778843-21ea-439e-8030-bf3fe47839c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073931 Nov 28 06:56:47 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 313/920] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:49 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:49 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=8 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:49 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:49 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=26 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3a583a-f470-4959-8515-1b1ddfe471c0", "name": "network-vif-plugged", "status": "completed", "tag": "75d293fb-d78b-480f-a0a9-0f98b3d606e7"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:56:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] Creating event network-vif-plugged:75d293fb-d78b-480f-a0a9-0f98b3d606e7 for instance af3a583a-f470-4959-8515-1b1ddfe471c0 on user Nov 28 06:56:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-b946a974-e0b7-483e-b835-407be1601b44 req-6a0e93f1-4710-4ede-ae20-8f05dd5fff50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043003 Nov 28 06:56:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 305/921] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:56:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-1cf5bd67-2265-4963-a83b-431b52b50964 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-1cf5bd67-2265-4963-a83b-431b52b50964 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1cf5bd67-2265-4963-a83b-431b52b50964 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1cf5bd67-2265-4963-a83b-431b52b50964 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1cf5bd67-2265-4963-a83b-431b52b50964 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1cf5bd67-2265-4963-a83b-431b52b50964 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1cf5bd67-2265-4963-a83b-431b52b50964 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-1cf5bd67-2265-4963-a83b-431b52b50964 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:56:55 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-1cf5bd67-2265-4963-a83b-431b52b50964 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:56:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-1cf5bd67-2265-4963-a83b-431b52b50964 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 200 len: 1555 microversion: 2.1 time: 0.293126 Nov 28 06:56:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 304/922] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:56:55 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 1555 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:57:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:05 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-dfa0cda3-3e81-4453-8de7-375d682dfe9a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:05 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-dfa0cda3-3e81-4453-8de7-375d682dfe9a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfa0cda3-3e81-4453-8de7-375d682dfe9a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfa0cda3-3e81-4453-8de7-375d682dfe9a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfa0cda3-3e81-4453-8de7-375d682dfe9a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfa0cda3-3e81-4453-8de7-375d682dfe9a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfa0cda3-3e81-4453-8de7-375d682dfe9a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfa0cda3-3e81-4453-8de7-375d682dfe9a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:05 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-dfa0cda3-3e81-4453-8de7-375d682dfe9a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-volume_attachments/d1afd034-1bbc-43d2-8928-4c42295bcc8a" status: 200 len: 194 microversion: 2.20 time: 0.350153 Nov 28 06:57:05 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 314/923] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Nov 28 06:57:04 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-volume_attachments/d1afd034-1bbc-43d2-8928-4c42295bcc8a => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:05 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'services' on Instance uuid 4fe14a8c-afa2-43b4-a885-914f4c8195ad {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:57:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-db6469ed-09d2-4c37-ae39-a248d001fd3c tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-volume_attachments/d1afd034-1bbc-43d2-8928-4c42295bcc8a" status: 202 len: 0 microversion: 2.20 time: 0.198069 Nov 28 06:57:05 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 306/924] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 06:57:05 2023] DELETE /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-volume_attachments/d1afd034-1bbc-43d2-8928-4c42295bcc8a => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:57:05 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d0c1e5d7-8fe5-4733-a1e4-74afab4b4019 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:05 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d0c1e5d7-8fe5-4733-a1e4-74afab4b4019 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:05 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d0c1e5d7-8fe5-4733-a1e4-74afab4b4019 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d0c1e5d7-8fe5-4733-a1e4-74afab4b4019 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d0c1e5d7-8fe5-4733-a1e4-74afab4b4019 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d0c1e5d7-8fe5-4733-a1e4-74afab4b4019 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d0c1e5d7-8fe5-4733-a1e4-74afab4b4019 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d0c1e5d7-8fe5-4733-a1e4-74afab4b4019 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:05 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d0c1e5d7-8fe5-4733-a1e4-74afab4b4019 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056252 Nov 28 06:57:05 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 305/925] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 06:57:05 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: e23537de-fa1e-4cd2-8050-04ef2b911ac8] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] HTTP exception thrown: Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 could not be found. Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Returning 404 to user: Instance e23537de-fa1e-4cd2-8050-04ef2b911ac8 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:57:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1342f9b4-2442-487e-8861-d43134ab9ad9 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8" status: 404 len: 111 microversion: 2.87 time: 0.063088 Nov 28 06:57:08 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 315/926] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:57:08 2023] GET /compute/v2.1/servers/e23537de-fa1e-4cd2-8050-04ef2b911ac8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:57:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:08 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:08 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:57:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-24ce1bfe-960f-4325-bf2c-93bac92c4d99 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5" status: 204 len: 0 microversion: 2.87 time: 0.126615 Nov 28 06:57:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 307/927] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:57:08 2023] DELETE /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:08 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:08 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ea167103-4545-41bf-8b41-32b93442ac9f tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5" status: 200 len: 1776 microversion: 2.87 time: 0.310509 Nov 28 06:57:08 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 306/928] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:57:08 2023] GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5 => generated 1776 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-unplugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] Creating event network-vif-unplugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:57:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-7ccb4ea7-774a-4d63-b1b9-57109a885f12 req-ed1fb157-272f-4f4a-a322-39275dfa374c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037285 Nov 28 06:57:08 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 316/929] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-148133998", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] validate_networks() for None {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Getting quotas for project 5be34184767f4a7b8ebc4754702407d8. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Getting quotas for user 97c40e11f74d48798534d16ef676529f and project 5be34184767f4a7b8ebc4754702407d8. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:57:09 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:57:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-510a6482-b0e6-4b53-8f60-ca8557f8afaa tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.413358 Nov 28 06:57:09 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 308/930] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:57:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:57:09 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e42c672c-3f48-43ca-84fa-c5fdef7ad86f tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:09 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e42c672c-3f48-43ca-84fa-c5fdef7ad86f tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:09 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-e42c672c-3f48-43ca-84fa-c5fdef7ad86f tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c40e11f74d48798534d16ef676529f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be34184767f4a7b8ebc4754702407d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e42c672c-3f48-43ca-84fa-c5fdef7ad86f tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038840e0-306b-466b-8dea-75d8cf2ea261" status: 200 len: 1206 microversion: 2.1 time: 0.058809 Nov 28 06:57:09 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 307/931] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:57:09 2023] GET /compute/v2.1/servers/038840e0-306b-466b-8dea-75d8cf2ea261 => generated 1206 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:57:09 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-f69702b1-a8e1-4ffe-878f-a3f4f66b2682 req-42d098db-f1f2-486e-903d-48ef33e018d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-deleted", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f69702b1-a8e1-4ffe-878f-a3f4f66b2682 req-42d098db-f1f2-486e-903d-48ef33e018d0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f69702b1-a8e1-4ffe-878f-a3f4f66b2682 req-42d098db-f1f2-486e-903d-48ef33e018d0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f69702b1-a8e1-4ffe-878f-a3f4f66b2682 req-42d098db-f1f2-486e-903d-48ef33e018d0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f69702b1-a8e1-4ffe-878f-a3f4f66b2682 req-42d098db-f1f2-486e-903d-48ef33e018d0 service nova] Creating event network-vif-deleted:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:57:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-f69702b1-a8e1-4ffe-878f-a3f4f66b2682 req-42d098db-f1f2-486e-903d-48ef33e018d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036405 Nov 28 06:57:09 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 317/932] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:10 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea1149f-7553-4beb-b8df-87822bd3abd5", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa54ed-54c8-4e8f-8009-95df2712735d"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:10 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] Creating event network-vif-plugged:d2fa54ed-54c8-4e8f-8009-95df2712735d for instance eea1149f-7553-4beb-b8df-87822bd3abd5 on user Nov 28 06:57:10 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-a2e62dae-952a-4836-b856-75d10cf5494f req-83c5ee21-b5da-4037-860e-f91d75761dc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028981 Nov 28 06:57:10 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 309/933] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:12 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038840e0-306b-466b-8dea-75d8cf2ea261", "tag": "486a31d1-881b-4b3c-882d-1baba88d88c2"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:12 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] Creating event network-changed:486a31d1-881b-4b3c-882d-1baba88d88c2 for instance 038840e0-306b-466b-8dea-75d8cf2ea261 on user Nov 28 06:57:12 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-07468837-bd0a-41cd-b2f6-9cc0f636af52 req-49fa53bf-c77e-469e-8409-3c6d68fb8faf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030560 Nov 28 06:57:12 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 308/934] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-923daf99-094d-4a1e-8b03-bd1b93271be5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:14 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-923daf99-094d-4a1e-8b03-bd1b93271be5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-923daf99-094d-4a1e-8b03-bd1b93271be5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-923daf99-094d-4a1e-8b03-bd1b93271be5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-923daf99-094d-4a1e-8b03-bd1b93271be5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-923daf99-094d-4a1e-8b03-bd1b93271be5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-923daf99-094d-4a1e-8b03-bd1b93271be5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-923daf99-094d-4a1e-8b03-bd1b93271be5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:14 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038840e0-306b-466b-8dea-75d8cf2ea261", "name": "network-vif-plugged", "status": "completed", "tag": "486a31d1-881b-4b3c-882d-1baba88d88c2"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] Creating event network-vif-plugged:486a31d1-881b-4b3c-882d-1baba88d88c2 for instance 038840e0-306b-466b-8dea-75d8cf2ea261 on user Nov 28 06:57:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-67858f8d-d00d-4df5-adbb-0d935a090b30 req-9f663491-d681-4891-b303-959230d8367f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216888 Nov 28 06:57:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 310/935] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:14 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-923daf99-094d-4a1e-8b03-bd1b93271be5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-923daf99-094d-4a1e-8b03-bd1b93271be5 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4" status: 200 len: 1534 microversion: 2.1 time: 0.413568 Nov 28 06:57:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 318/936] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:57:14 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4 => generated 1534 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:57:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-2a8ace32-2d7c-4ea9-b978-06a6a1369e08 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:15 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-2a8ace32-2d7c-4ea9-b978-06a6a1369e08 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2a8ace32-2d7c-4ea9-b978-06a6a1369e08 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2a8ace32-2d7c-4ea9-b978-06a6a1369e08 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2a8ace32-2d7c-4ea9-b978-06a6a1369e08 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2a8ace32-2d7c-4ea9-b978-06a6a1369e08 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2a8ace32-2d7c-4ea9-b978-06a6a1369e08 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2a8ace32-2d7c-4ea9-b978-06a6a1369e08 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:15 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-2a8ace32-2d7c-4ea9-b978-06a6a1369e08 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-2a8ace32-2d7c-4ea9-b978-06a6a1369e08 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0" status: 200 len: 1377 microversion: 2.1 time: 0.262806 Nov 28 06:57:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 309/937] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:57:15 2023] GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0 => generated 1377 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:57:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038840e0-306b-466b-8dea-75d8cf2ea261", "name": "network-vif-plugged", "status": "completed", "tag": "486a31d1-881b-4b3c-882d-1baba88d88c2"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] Creating event network-vif-plugged:486a31d1-881b-4b3c-882d-1baba88d88c2 for instance 038840e0-306b-466b-8dea-75d8cf2ea261 on user Nov 28 06:57:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-8574ef0c-35e9-46f2-80f7-44da9b28a7f4 req-505e2d0a-87ee-4177-8361-f99740c9073f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029157 Nov 28 06:57:16 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 311/938] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:39 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4c5b2beb-a436-4b47-b9b3-b9074b0840e9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Action: 'create', calling method: .version_select at 0x7f0b0375f490>, body: {"keypair": {"name": "tempest-keypair-536756227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTeezUJfCy/PdT+5o55bBNniwqT/C6qqK5jybin9WqPIXvk//VYsW599FvWs1SqmYte1wj8MgqbzNjVg0sbpCKLN+EFeGh1OIohCgRfN10CZaS+lJIKEf4/u7bdxWEOVA=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:39 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=10 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:39 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=18 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:39 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-4c5b2beb-a436-4b47-b9b3-b9074b0840e9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting quotas for project 82be9b17ed614b8aa2bb7172eedf516e. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:57:39 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-4c5b2beb-a436-4b47-b9b3-b9074b0840e9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting quotas for user 37eb76cab93f4dfd97bf85828d89df68 and project 82be9b17ed614b8aa2bb7172eedf516e. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:57:39 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4c5b2beb-a436-4b47-b9b3-b9074b0840e9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054000 Nov 28 06:57:39 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 319/939] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:57:39 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1110125265", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "e362119a-300d-496b-a211-8b1a13b2edf8"}], "security_groups": [{"name": "tempest-securitygroup--179262823"}], "key_name": "tempest-keypair-536756227", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=14 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=26 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] validate_networks() for [('e362119a-300d-496b-a211-8b1a13b2edf8', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting quotas for project 82be9b17ed614b8aa2bb7172eedf516e. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting quotas for user 37eb76cab93f4dfd97bf85828d89df68 and project 82be9b17ed614b8aa2bb7172eedf516e. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:57:41 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:57:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-18a7fadb-31df-4c6d-a126-7158698eb6cc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.560090 Nov 28 06:57:41 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 310/940] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:57:41 2023] POST /compute/v2.1/servers => generated 403 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:57:41 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:41 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:41 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:41 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:41 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b69a8ba3-6598-4fef-9514-eac84b777f0b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:41 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-b69a8ba3-6598-4fef-9514-eac84b777f0b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:41 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-b69a8ba3-6598-4fef-9514-eac84b777f0b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eb76cab93f4dfd97bf85828d89df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82be9b17ed614b8aa2bb7172eedf516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-b69a8ba3-6598-4fef-9514-eac84b777f0b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "GET /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f" status: 200 len: 1234 microversion: 2.1 time: 0.076469 Nov 28 06:57:41 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 312/941] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:57:41 2023] GET /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f => generated 1234 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:57:44 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572ab6e9-7bbc-44ad-9e20-c53c17ed333f", "tag": "e801ef0c-430d-49ef-8691-ef7c7678c8c5"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:44 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] Creating event network-changed:e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f on user Nov 28 06:57:44 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-8b691b5c-2b95-4dd7-84ba-bdd5d246c0bb req-328a310d-7da9-4be2-9d39-db75ed317f0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032252 Nov 28 06:57:44 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 320/942] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ab6e9-7bbc-44ad-9e20-c53c17ed333f", "name": "network-vif-plugged", "status": "completed", "tag": "e801ef0c-430d-49ef-8691-ef7c7678c8c5"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] Creating event network-vif-plugged:e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f on user Nov 28 06:57:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-87961391-0336-4164-bc94-6fd4ce13f805 req-f124132b-ea09-46f3-ae6f-3e325f8b9599 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031927 Nov 28 06:57:46 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 311/943] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:48 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ab6e9-7bbc-44ad-9e20-c53c17ed333f", "name": "network-vif-plugged", "status": "completed", "tag": "e801ef0c-430d-49ef-8691-ef7c7678c8c5"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:48 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] Creating event network-vif-plugged:e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f on user Nov 28 06:57:48 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-6c02c44b-5eb7-4aea-82a6-476f72594540 req-952c63bc-38e9-4712-90a2-31af2cff084a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047480 Nov 28 06:57:48 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 313/944] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-92c2cfc5-4d35-410f-a922-fcd133f10246 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-92c2cfc5-4d35-410f-a922-fcd133f10246 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-92c2cfc5-4d35-410f-a922-fcd133f10246 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-92c2cfc5-4d35-410f-a922-fcd133f10246 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-92c2cfc5-4d35-410f-a922-fcd133f10246 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-92c2cfc5-4d35-410f-a922-fcd133f10246 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-92c2cfc5-4d35-410f-a922-fcd133f10246 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-92c2cfc5-4d35-410f-a922-fcd133f10246 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-92c2cfc5-4d35-410f-a922-fcd133f10246 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054859 Nov 28 06:57:55 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 321/945] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 06:57:55 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:55 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-fb807699-87c8-4229-ae74-9916730eecaf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "POST /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad/action" status: 204 len: 0 microversion: 2.1 time: 0.074549 Nov 28 06:57:55 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 314/946] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:57:55 2023] POST /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a352a613-86c8-4cd4-93e9-1175b30721e3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a352a613-86c8-4cd4-93e9-1175b30721e3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-859e61f8-c8ad-40e4-9592-633ca095b229 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 204 len: 0 microversion: 2.20 time: 0.132641 Nov 28 06:57:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 312/947] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:57:55 2023] DELETE /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a352a613-86c8-4cd4-93e9-1175b30721e3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a352a613-86c8-4cd4-93e9-1175b30721e3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a352a613-86c8-4cd4-93e9-1175b30721e3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a352a613-86c8-4cd4-93e9-1175b30721e3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a352a613-86c8-4cd4-93e9-1175b30721e3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a352a613-86c8-4cd4-93e9-1175b30721e3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:55 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:56 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-a352a613-86c8-4cd4-93e9-1175b30721e3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a352a613-86c8-4cd4-93e9-1175b30721e3 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 200 len: 1555 microversion: 2.1 time: 0.246463 Nov 28 06:57:56 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 322/948] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:57:55 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:57:56 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-unplugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:56 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] Creating event network-vif-unplugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:57:56 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-c6886495-8e04-4a34-9fae-c80758f3d558 req-4b2ef8a1-5584-425b-9e27-c7b98a23a6df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037670 Nov 28 06:57:56 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 313/949] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:57:56 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:56 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:56 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-452f27f4-5d00-40b8-b26a-5d2fd1244af5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 200 len: 1707 microversion: 2.20 time: 0.757039 Nov 28 06:57:56 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 315/950] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:57:55 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 1707 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:57:58 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-plugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}, {"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-plugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}, {"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-plugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}, {"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-unplugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}, {"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-plugged", "status": "completed", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}, {"server_uuid": "4fe14a8c-afa2-43b4-a885-914f4c8195ad", "name": "network-vif-deleted", "tag": "fc037856-716e-436b-b551-55cd7f2497cc"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:57:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:58 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:58 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Creating event network-vif-plugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:57:58 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Creating event network-vif-plugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:57:58 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Creating event network-vif-plugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:57:58 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Creating event network-vif-unplugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:57:58 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Creating event network-vif-plugged:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:57:58 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] Creating event network-vif-deleted:fc037856-716e-436b-b551-55cd7f2497cc for instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad on user Nov 28 06:57:58 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-f29ee2a3-0cc3-49f3-89f6-4f24cbb0183a req-0f1c0bd6-33fa-49a2-87da-b99ef4aa1aa9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.078376 Nov 28 06:57:58 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 323/951] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:57:58 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:57:58 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:58 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: eea1149f-7553-4beb-b8df-87822bd3abd5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] HTTP exception thrown: Instance eea1149f-7553-4beb-b8df-87822bd3abd5 could not be found. Nov 28 06:57:58 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Returning 404 to user: Instance eea1149f-7553-4beb-b8df-87822bd3abd5 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:57:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-61bc2165-9207-41a4-8cb2-1253f65e139b tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5" status: 404 len: 111 microversion: 2.87 time: 0.027989 Nov 28 06:57:58 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 314/952] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:57:58 2023] GET /compute/v2.1/servers/eea1149f-7553-4beb-b8df-87822bd3abd5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:57:58 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:58 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:58 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:58 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:57:59 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-cb777bf8-35bd-43ab-b5f1-168917834f6c tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62" status: 204 len: 0 microversion: 2.87 time: 0.103815 Nov 28 06:57:59 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 316/953] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 06:57:58 2023] DELETE /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:59 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c13b793a926942e88fc3416cf3fa005e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e9312175c4e73aa29a51865d61ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:59 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4103298f-0c13-45f5-b4f7-60a50b46df48 tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62" status: 200 len: 1698 microversion: 2.87 time: 0.268357 Nov 28 06:57:59 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 324/954] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:57:59 2023] GET /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62 => generated 1698 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:57:59 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5fcb20ad-8abf-457c-80e7-10ad7cba91a8 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:57:59 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-5fcb20ad-8abf-457c-80e7-10ad7cba91a8 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:57:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5fcb20ad-8abf-457c-80e7-10ad7cba91a8 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5fcb20ad-8abf-457c-80e7-10ad7cba91a8 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5fcb20ad-8abf-457c-80e7-10ad7cba91a8 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5fcb20ad-8abf-457c-80e7-10ad7cba91a8 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:57:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5fcb20ad-8abf-457c-80e7-10ad7cba91a8 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:57:59 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5fcb20ad-8abf-457c-80e7-10ad7cba91a8 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:57:59 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-5fcb20ad-8abf-457c-80e7-10ad7cba91a8 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c40e11f74d48798534d16ef676529f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be34184767f4a7b8ebc4754702407d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:57:59 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5fcb20ad-8abf-457c-80e7-10ad7cba91a8 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038840e0-306b-466b-8dea-75d8cf2ea261" status: 200 len: 1452 microversion: 2.1 time: 0.208766 Nov 28 06:57:59 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 315/955] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:57:59 2023] GET /compute/v2.1/servers/038840e0-306b-466b-8dea-75d8cf2ea261 => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:58:00 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b630563-12cc-467d-8908-e2a8fb230b62", "name": "network-vif-unplugged", "status": "completed", "tag": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a"}, {"server_uuid": "0b630563-12cc-467d-8908-e2a8fb230b62", "name": "network-vif-plugged", "status": "completed", "tag": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Creating event network-vif-unplugged:f14d8817-78b1-4d77-b312-3d5ccaab9d4a for instance 0b630563-12cc-467d-8908-e2a8fb230b62 on user Nov 28 06:58:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] Creating event network-vif-plugged:f14d8817-78b1-4d77-b312-3d5ccaab9d4a for instance 0b630563-12cc-467d-8908-e2a8fb230b62 on user Nov 28 06:58:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-a0381900-cc68-44dc-b9e2-0da487a12a06 req-4945a445-c512-4349-a5c8-fdeabd23b92c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.042201 Nov 28 06:58:00 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 317/956] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:58:00 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:02 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-d3f4bb06-8274-4deb-a108-dd03b9bbed32 req-1b27a84a-1875-401d-9182-480b32378860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b630563-12cc-467d-8908-e2a8fb230b62", "name": "network-vif-deleted", "tag": "f14d8817-78b1-4d77-b312-3d5ccaab9d4a"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d3f4bb06-8274-4deb-a108-dd03b9bbed32 req-1b27a84a-1875-401d-9182-480b32378860 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d3f4bb06-8274-4deb-a108-dd03b9bbed32 req-1b27a84a-1875-401d-9182-480b32378860 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d3f4bb06-8274-4deb-a108-dd03b9bbed32 req-1b27a84a-1875-401d-9182-480b32378860 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-d3f4bb06-8274-4deb-a108-dd03b9bbed32 req-1b27a84a-1875-401d-9182-480b32378860 service nova] Creating event network-vif-deleted:f14d8817-78b1-4d77-b312-3d5ccaab9d4a for instance 0b630563-12cc-467d-8908-e2a8fb230b62 on user Nov 28 06:58:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-d3f4bb06-8274-4deb-a108-dd03b9bbed32 req-1b27a84a-1875-401d-9182-480b32378860 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029591 Nov 28 06:58:02 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 325/957] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:58:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:14 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-126ba782-e38f-410e-8a97-390d7a4543bd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:14 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-126ba782-e38f-410e-8a97-390d7a4543bd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:14 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:14 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-126ba782-e38f-410e-8a97-390d7a4543bd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-126ba782-e38f-410e-8a97-390d7a4543bd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-126ba782-e38f-410e-8a97-390d7a4543bd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-126ba782-e38f-410e-8a97-390d7a4543bd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-126ba782-e38f-410e-8a97-390d7a4543bd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-126ba782-e38f-410e-8a97-390d7a4543bd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:14 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-126ba782-e38f-410e-8a97-390d7a4543bd tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.142959 Nov 28 06:58:14 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 316/958] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:58:14 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-interface => generated 282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e60471-f6da-476c-b0de-c729eec1b2b4", "tag": "97da79b7-c41c-46da-8faa-03d072c630a6"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:15 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] Creating event network-changed:97da79b7-c41c-46da-8faa-03d072c630a6 for instance 92e60471-f6da-476c-b0de-c729eec1b2b4 on user Nov 28 06:58:15 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-a01ce689-1072-48ad-aa0a-d1d2e86717ec req-b0e4059f-6fab-4a1c-95c5-099c1b71e8f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040657 Nov 28 06:58:15 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 318/959] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:58:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:15 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=12 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:15 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=22 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1baa0bd4-cdee-44ac-8cfd-07d8d8f18cda tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:15 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1baa0bd4-cdee-44ac-8cfd-07d8d8f18cda tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1baa0bd4-cdee-44ac-8cfd-07d8d8f18cda tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1baa0bd4-cdee-44ac-8cfd-07d8d8f18cda tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1baa0bd4-cdee-44ac-8cfd-07d8d8f18cda tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1baa0bd4-cdee-44ac-8cfd-07d8d8f18cda tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1baa0bd4-cdee-44ac-8cfd-07d8d8f18cda tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1baa0bd4-cdee-44ac-8cfd-07d8d8f18cda tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1baa0bd4-cdee-44ac-8cfd-07d8d8f18cda tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/ips" status: 200 len: 104 microversion: 2.1 time: 0.042161 Nov 28 06:58:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 326/960] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 06:58:15 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/ips => generated 104 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ca572c87-15e0-4a88-b476-ac0c8157a88c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:15 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ca572c87-15e0-4a88-b476-ac0c8157a88c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca572c87-15e0-4a88-b476-ac0c8157a88c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca572c87-15e0-4a88-b476-ac0c8157a88c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca572c87-15e0-4a88-b476-ac0c8157a88c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca572c87-15e0-4a88-b476-ac0c8157a88c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca572c87-15e0-4a88-b476-ac0c8157a88c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ca572c87-15e0-4a88-b476-ac0c8157a88c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:15 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-ca572c87-15e0-4a88-b476-ac0c8157a88c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:58:15 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ca572c87-15e0-4a88-b476-ac0c8157a88c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0" status: 200 len: 1377 microversion: 2.1 time: 0.307276 Nov 28 06:58:15 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 317/961] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:58:15 2023] GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0 => generated 1377 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ad4cacaf-7a11-4b6d-aab5-b1b62878ce59 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-ad4cacaf-7a11-4b6d-aab5-b1b62878ce59 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ad4cacaf-7a11-4b6d-aab5-b1b62878ce59 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ad4cacaf-7a11-4b6d-aab5-b1b62878ce59 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ad4cacaf-7a11-4b6d-aab5-b1b62878ce59 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ad4cacaf-7a11-4b6d-aab5-b1b62878ce59 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ad4cacaf-7a11-4b6d-aab5-b1b62878ce59 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:15 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ad4cacaf-7a11-4b6d-aab5-b1b62878ce59 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:16 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-ad4cacaf-7a11-4b6d-aab5-b1b62878ce59 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:58:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-ad4cacaf-7a11-4b6d-aab5-b1b62878ce59 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0" status: 200 len: 1377 microversion: 2.1 time: 0.209075 Nov 28 06:58:16 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 319/962] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:58:15 2023] GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0 => generated 1377 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:58:16 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:16 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:16 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:58:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-419e77ef-a546-46c0-a536-4a601b23a594 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0" status: 204 len: 0 microversion: 2.1 time: 0.139585 Nov 28 06:58:16 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 327/963] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:58:16 2023] DELETE /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:58:16 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f9a045d4-b0a8-406f-a854-6d6372749775 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:16 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f9a045d4-b0a8-406f-a854-6d6372749775 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9a045d4-b0a8-406f-a854-6d6372749775 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9a045d4-b0a8-406f-a854-6d6372749775 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9a045d4-b0a8-406f-a854-6d6372749775 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9a045d4-b0a8-406f-a854-6d6372749775 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9a045d4-b0a8-406f-a854-6d6372749775 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f9a045d4-b0a8-406f-a854-6d6372749775 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:16 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-f9a045d4-b0a8-406f-a854-6d6372749775 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:58:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f9a045d4-b0a8-406f-a854-6d6372749775 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0" status: 200 len: 1383 microversion: 2.1 time: 0.220906 Nov 28 06:58:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 318/964] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:58:16 2023] GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0 => generated 1383 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:58:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3a583a-f470-4959-8515-1b1ddfe471c0", "name": "network-vif-unplugged", "status": "completed", "tag": "75d293fb-d78b-480f-a0a9-0f98b3d606e7"}, {"server_uuid": "af3a583a-f470-4959-8515-1b1ddfe471c0", "name": "network-vif-plugged", "status": "completed", "tag": "75d293fb-d78b-480f-a0a9-0f98b3d606e7"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Creating event network-vif-unplugged:75d293fb-d78b-480f-a0a9-0f98b3d606e7 for instance af3a583a-f470-4959-8515-1b1ddfe471c0 on user Nov 28 06:58:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] Creating event network-vif-plugged:75d293fb-d78b-480f-a0a9-0f98b3d606e7 for instance af3a583a-f470-4959-8515-1b1ddfe471c0 on user Nov 28 06:58:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-4c670643-5e0c-4377-824c-6564cf08b25e req-db4dce45-6c31-4fd3-8ec5-4660f64fc94c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029721 Nov 28 06:58:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 320/965] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:58:17 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:58:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80544c11-3c17-4319-8489-8c4e24a58fe7"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:17 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-ef7bc961-bc16-44e3-b6d5-ffe61d1847b2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533695 Nov 28 06:58:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 328/966] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:58:17 2023] POST /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments => generated 194 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:19 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-f4df9d69-eb5e-4913-ba71-8161636d0134 req-a1b33b0b-4611-44ed-8d95-54fd3750c780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3a583a-f470-4959-8515-1b1ddfe471c0", "name": "network-vif-deleted", "tag": "75d293fb-d78b-480f-a0a9-0f98b3d606e7"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f4df9d69-eb5e-4913-ba71-8161636d0134 req-a1b33b0b-4611-44ed-8d95-54fd3750c780 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f4df9d69-eb5e-4913-ba71-8161636d0134 req-a1b33b0b-4611-44ed-8d95-54fd3750c780 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:19 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f4df9d69-eb5e-4913-ba71-8161636d0134 req-a1b33b0b-4611-44ed-8d95-54fd3750c780 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:19 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-f4df9d69-eb5e-4913-ba71-8161636d0134 req-a1b33b0b-4611-44ed-8d95-54fd3750c780 service nova] Creating event network-vif-deleted:75d293fb-d78b-480f-a0a9-0f98b3d606e7 for instance af3a583a-f470-4959-8515-1b1ddfe471c0 on user Nov 28 06:58:19 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-f4df9d69-eb5e-4913-ba71-8161636d0134 req-a1b33b0b-4611-44ed-8d95-54fd3750c780 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033588 Nov 28 06:58:19 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 319/967] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:58:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:28 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:28 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=10 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:28 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8d72b216-5226-4b94-bbc0-7732fe38031a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:28 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8d72b216-5226-4b94-bbc0-7732fe38031a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d72b216-5226-4b94-bbc0-7732fe38031a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d72b216-5226-4b94-bbc0-7732fe38031a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d72b216-5226-4b94-bbc0-7732fe38031a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d72b216-5226-4b94-bbc0-7732fe38031a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d72b216-5226-4b94-bbc0-7732fe38031a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d72b216-5226-4b94-bbc0-7732fe38031a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:28 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-8d72b216-5226-4b94-bbc0-7732fe38031a tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050432 Nov 28 06:58:28 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 321/968] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:58:28 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:28 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:28 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f5745a6c-b866-4345-8635-43ee1b76436c tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:28 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f5745a6c-b866-4345-8635-43ee1b76436c tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5745a6c-b866-4345-8635-43ee1b76436c tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5745a6c-b866-4345-8635-43ee1b76436c tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5745a6c-b866-4345-8635-43ee1b76436c tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5745a6c-b866-4345-8635-43ee1b76436c tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5745a6c-b866-4345-8635-43ee1b76436c tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5745a6c-b866-4345-8635-43ee1b76436c tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:28 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f5745a6c-b866-4345-8635-43ee1b76436c tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments/80544c11-3c17-4319-8489-8c4e24a58fe7" status: 200 len: 194 microversion: 2.1 time: 0.048309 Nov 28 06:58:28 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 329/969] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 06:58:28 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments/80544c11-3c17-4319-8489-8c4e24a58fe7 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:30 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=8 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:30 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=18 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:30 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de5af4b7-5758-4a72-bf9f-738feb2c01c8"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:30 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:30 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:31 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-02629302-b1c4-49ff-a06e-e32b56e12842 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368494 Nov 28 06:58:31 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 320/970] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:58:30 2023] POST /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:32 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1f3a5009-ea2e-48cb-b402-8c3c67c5c4b5 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:32 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-1f3a5009-ea2e-48cb-b402-8c3c67c5c4b5 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f3a5009-ea2e-48cb-b402-8c3c67c5c4b5 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f3a5009-ea2e-48cb-b402-8c3c67c5c4b5 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f3a5009-ea2e-48cb-b402-8c3c67c5c4b5 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f3a5009-ea2e-48cb-b402-8c3c67c5c4b5 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f3a5009-ea2e-48cb-b402-8c3c67c5c4b5 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1f3a5009-ea2e-48cb-b402-8c3c67c5c4b5 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:32 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-1f3a5009-ea2e-48cb-b402-8c3c67c5c4b5 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eb76cab93f4dfd97bf85828d89df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82be9b17ed614b8aa2bb7172eedf516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:58:32 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1f3a5009-ea2e-48cb-b402-8c3c67c5c4b5 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "GET /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f" status: 200 len: 1542 microversion: 2.1 time: 0.199682 Nov 28 06:58:32 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 322/971] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:58:32 2023] GET /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f => generated 1542 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:58:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b6455c6e-d2fd-458e-af50-bf9ef29767e0 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:40 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-b6455c6e-d2fd-458e-af50-bf9ef29767e0 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:40 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:40 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b6455c6e-d2fd-458e-af50-bf9ef29767e0 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b6455c6e-d2fd-458e-af50-bf9ef29767e0 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b6455c6e-d2fd-458e-af50-bf9ef29767e0 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b6455c6e-d2fd-458e-af50-bf9ef29767e0 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b6455c6e-d2fd-458e-af50-bf9ef29767e0 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b6455c6e-d2fd-458e-af50-bf9ef29767e0 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b6455c6e-d2fd-458e-af50-bf9ef29767e0 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.070462 Nov 28 06:58:40 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 330/972] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:58:40 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:41 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:58:41 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-66518db9-3841-4114-97fb-fc9173ffcb8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:41 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-66518db9-3841-4114-97fb-fc9173ffcb8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-66518db9-3841-4114-97fb-fc9173ffcb8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-66518db9-3841-4114-97fb-fc9173ffcb8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-66518db9-3841-4114-97fb-fc9173ffcb8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-66518db9-3841-4114-97fb-fc9173ffcb8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-66518db9-3841-4114-97fb-fc9173ffcb8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-66518db9-3841-4114-97fb-fc9173ffcb8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-66518db9-3841-4114-97fb-fc9173ffcb8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments/80544c11-3c17-4319-8489-8c4e24a58fe7" status: 200 len: 194 microversion: 2.1 time: 0.041129 Nov 28 06:58:41 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 321/973] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 06:58:41 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments/80544c11-3c17-4319-8489-8c4e24a58fe7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:41 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:41 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:41 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'services' on Instance uuid 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:58:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-be62c172-a6a2-4af8-b66b-cf959c3c4106 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments/80544c11-3c17-4319-8489-8c4e24a58fe7" status: 202 len: 0 microversion: 2.1 time: 0.213902 Nov 28 06:58:41 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 323/974] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:58:41 2023] DELETE /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments/80544c11-3c17-4319-8489-8c4e24a58fe7 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:58:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-ee1a3e55-c668-4a09-9ade-fa263cfffa92 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:46 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-ee1a3e55-c668-4a09-9ade-fa263cfffa92 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ee1a3e55-c668-4a09-9ade-fa263cfffa92 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ee1a3e55-c668-4a09-9ade-fa263cfffa92 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ee1a3e55-c668-4a09-9ade-fa263cfffa92 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ee1a3e55-c668-4a09-9ade-fa263cfffa92 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ee1a3e55-c668-4a09-9ade-fa263cfffa92 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ee1a3e55-c668-4a09-9ade-fa263cfffa92 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:46 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-ee1a3e55-c668-4a09-9ade-fa263cfffa92 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:58:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-ee1a3e55-c668-4a09-9ade-fa263cfffa92 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 200 len: 1547 microversion: 2.1 time: 0.266806 Nov 28 06:58:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 331/975] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:58:46 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 1547 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:58:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:46 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] HTTP exception thrown: Instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad could not be found. Nov 28 06:58:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Returning 404 to user: Instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:58:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-3c2c2297-f533-4fce-8ac4-0823d933e95f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 404 len: 111 microversion: 2.20 time: 0.026024 Nov 28 06:58:46 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 322/976] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:58:46 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:58:46 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1d75b124-1d66-4791-995f-32298f84b724 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '.version_select at 0x7f0b03caee60>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1d75b124-1d66-4791-995f-32298f84b724 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259314972" status: 204 len: 0 microversion: 2.20 time: 0.024489 Nov 28 06:58:46 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 324/977] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 28 06:58:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259314972 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 06:58:47 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-8c4426a3-0df6-4463-ac6e-2c47686abe2f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Action: 'create', calling method: .version_select at 0x7f0b035f09d0>, body: {"keypair": {"name": "tempest-keypair-1691834733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQPwnK6lmjMoJybvl5cVU2MnwVHXFMNeaO8Rsnt98BjuMQVUOleaBJRxeVYQX7a8iMW/3nZ6jmfwOilHW6nIAGbi0+22NgwmT8lUhLxagB/l+ms7V0NW840WRlnEpKPZA=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:47 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-8c4426a3-0df6-4463-ac6e-2c47686abe2f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting quotas for project 9d769a1c976c468f804770d89c92ae94. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:58:47 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-8c4426a3-0df6-4463-ac6e-2c47686abe2f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting quotas for user dbf659ad4b8f43a2bc497d01be58d846 and project 9d769a1c976c468f804770d89c92ae94. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:58:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-8c4426a3-0df6-4463-ac6e-2c47686abe2f tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048232 Nov 28 06:58:47 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 332/978] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 06:58:47 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1985880305", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "33d7ba92-eb3a-4951-905c-54f3d9532751"}], "security_groups": [{"name": "tempest-securitygroup--1158296264"}], "key_name": "tempest-keypair-1691834733", "user_data": "}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] validate_networks() for [('33d7ba92-eb3a-4951-905c-54f3d9532751', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:58:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:49 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] [instance: 0b630563-12cc-467d-8908-e2a8fb230b62] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] HTTP exception thrown: Instance 0b630563-12cc-467d-8908-e2a8fb230b62 could not be found. Nov 28 06:58:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] Returning 404 to user: Instance 0b630563-12cc-467d-8908-e2a8fb230b62 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:58:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-84b675ec-8507-4c51-8fb0-04002f6cbcea tempest-ServerBootFromVolumeStableRescueTest-397751332 tempest-ServerBootFromVolumeStableRescueTest-397751332-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62" status: 404 len: 111 microversion: 2.87 time: 0.037088 Nov 28 06:58:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 325/979] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:58:49 2023] GET /compute/v2.1/servers/0b630563-12cc-467d-8908-e2a8fb230b62 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting quotas for project 9d769a1c976c468f804770d89c92ae94. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Getting quotas for user dbf659ad4b8f43a2bc497d01be58d846 and project 9d769a1c976c468f804770d89c92ae94. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:58:49 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:58:49 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-cedfa96f-663c-43b8-b395-ecdd7e40982a tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.545843 Nov 28 06:58:49 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 323/980] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 06:58:49 2023] POST /compute/v2.1/servers => generated 400 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 06:58:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-61ddc726-684e-4c16-b053-4f5679b9ac56 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:49 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-61ddc726-684e-4c16-b053-4f5679b9ac56 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:49 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-61ddc726-684e-4c16-b053-4f5679b9ac56 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:58:49 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-61ddc726-684e-4c16-b053-4f5679b9ac56 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:58:49 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-61ddc726-684e-4c16-b053-4f5679b9ac56 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:58:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-61ddc726-684e-4c16-b053-4f5679b9ac56 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 200 len: 1274 microversion: 2.20 time: 0.073244 Nov 28 06:58:49 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 333/981] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:58:49 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 1274 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:58:51 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:51 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] Creating event network-changed:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 06:58:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-ba08818c-af74-4995-a8d0-03bab5c4c65d req-6ed8ecb6-641b-442a-97f5-cd07fe9eabc1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097275 Nov 28 06:58:51 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 326/982] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:58:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:53 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "name": "network-vif-plugged", "status": "completed", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:53 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] Creating event network-vif-plugged:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 06:58:53 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-77c1c942-fd0a-42bb-8770-0616e0398dda req-1082080e-a817-47ea-b6dc-108bf60ec1c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056615 Nov 28 06:58:53 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 324/983] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:58:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:56 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "name": "network-vif-plugged", "status": "completed", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:58:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] Creating event network-vif-plugged:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 06:58:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-c4d11b17-e4bc-4f0c-bcf0-7b5aa2548225 req-4475b140-8600-4b84-a885-d1826e6fc284 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031525 Nov 28 06:58:56 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 334/984] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:58:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:58:59 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:58:59 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:58:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:58:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:58:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:58:59 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:59:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d8db9867-07bb-47f8-94cf-a6c1c83827fc tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/038840e0-306b-466b-8dea-75d8cf2ea261" status: 204 len: 0 microversion: 2.1 time: 0.135579 Nov 28 06:59:00 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 327/985] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:58:59 2023] DELETE /compute/v2.1/servers/038840e0-306b-466b-8dea-75d8cf2ea261 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-865a7ef0-bd40-4e62-80f0-4be4a35c133a tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-865a7ef0-bd40-4e62-80f0-4be4a35c133a tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-865a7ef0-bd40-4e62-80f0-4be4a35c133a tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-865a7ef0-bd40-4e62-80f0-4be4a35c133a tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-865a7ef0-bd40-4e62-80f0-4be4a35c133a tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-865a7ef0-bd40-4e62-80f0-4be4a35c133a tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-865a7ef0-bd40-4e62-80f0-4be4a35c133a tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-865a7ef0-bd40-4e62-80f0-4be4a35c133a tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:00 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038840e0-306b-466b-8dea-75d8cf2ea261", "name": "network-vif-unplugged", "status": "completed", "tag": "486a31d1-881b-4b3c-882d-1baba88d88c2"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:00 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-865a7ef0-bd40-4e62-80f0-4be4a35c133a tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c40e11f74d48798534d16ef676529f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be34184767f4a7b8ebc4754702407d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:59:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-865a7ef0-bd40-4e62-80f0-4be4a35c133a tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038840e0-306b-466b-8dea-75d8cf2ea261" status: 200 len: 1458 microversion: 2.1 time: 0.247699 Nov 28 06:59:00 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 325/986] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:59:00 2023] GET /compute/v2.1/servers/038840e0-306b-466b-8dea-75d8cf2ea261 => generated 1458 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:59:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] Creating event network-vif-unplugged:486a31d1-881b-4b3c-882d-1baba88d88c2 for instance 038840e0-306b-466b-8dea-75d8cf2ea261 on user Nov 28 06:59:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-537bdec0-1b69-4a6d-abce-c4022318682c req-a384abaf-ea67-4df9-ba71-5af74732dbd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146541 Nov 28 06:59:00 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 335/987] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:01 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-9f0fa85b-1938-4a16-8b60-6c149ed63bcb req-4e1dba7f-5dcc-4ff2-bbd3-fdb45ed7adbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038840e0-306b-466b-8dea-75d8cf2ea261", "name": "network-vif-deleted", "tag": "486a31d1-881b-4b3c-882d-1baba88d88c2"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9f0fa85b-1938-4a16-8b60-6c149ed63bcb req-4e1dba7f-5dcc-4ff2-bbd3-fdb45ed7adbb service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9f0fa85b-1938-4a16-8b60-6c149ed63bcb req-4e1dba7f-5dcc-4ff2-bbd3-fdb45ed7adbb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:01 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-9f0fa85b-1938-4a16-8b60-6c149ed63bcb req-4e1dba7f-5dcc-4ff2-bbd3-fdb45ed7adbb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-9f0fa85b-1938-4a16-8b60-6c149ed63bcb req-4e1dba7f-5dcc-4ff2-bbd3-fdb45ed7adbb service nova] Creating event network-vif-deleted:486a31d1-881b-4b3c-882d-1baba88d88c2 for instance 038840e0-306b-466b-8dea-75d8cf2ea261 on user Nov 28 06:59:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-9f0fa85b-1938-4a16-8b60-6c149ed63bcb req-4e1dba7f-5dcc-4ff2-bbd3-fdb45ed7adbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029143 Nov 28 06:59:01 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 328/988] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:59:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:02 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038840e0-306b-466b-8dea-75d8cf2ea261", "name": "network-vif-plugged", "status": "completed", "tag": "486a31d1-881b-4b3c-882d-1baba88d88c2"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] Creating event network-vif-plugged:486a31d1-881b-4b3c-882d-1baba88d88c2 for instance 038840e0-306b-466b-8dea-75d8cf2ea261 on user Nov 28 06:59:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-ddae335b-421a-48b3-8a75-9d94b64c0d0f req-a20026f7-cccd-4589-ac1c-44e5845b7c89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034623 Nov 28 06:59:02 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 326/989] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:03 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-91f8723e-3696-4868-b4b5-1578a3a24281 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:03 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-91f8723e-3696-4868-b4b5-1578a3a24281 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-91f8723e-3696-4868-b4b5-1578a3a24281 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-91f8723e-3696-4868-b4b5-1578a3a24281 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-91f8723e-3696-4868-b4b5-1578a3a24281 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-91f8723e-3696-4868-b4b5-1578a3a24281 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-91f8723e-3696-4868-b4b5-1578a3a24281 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:03 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-91f8723e-3696-4868-b4b5-1578a3a24281 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:03 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-91f8723e-3696-4868-b4b5-1578a3a24281 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments/de5af4b7-5758-4a72-bf9f-738feb2c01c8" status: 200 len: 194 microversion: 2.1 time: 0.039113 Nov 28 06:59:03 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 336/990] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 06:59:03 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments/de5af4b7-5758-4a72-bf9f-738feb2c01c8 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:03 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:03 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:03 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lazy-loading 'services' on Instance uuid 92e60471-f6da-476c-b0de-c729eec1b2b4 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 06:59:03 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-11f1797d-4947-4aa0-9668-4e7f7eeed171 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments/de5af4b7-5758-4a72-bf9f-738feb2c01c8" status: 202 len: 0 microversion: 2.1 time: 0.176785 Nov 28 06:59:03 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 329/991] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 06:59:03 2023] DELETE /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments/de5af4b7-5758-4a72-bf9f-738feb2c01c8 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 06:59:06 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:06 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance af3a583a-f470-4959-8515-1b1ddfe471c0 could not be found. Nov 28 06:59:06 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance af3a583a-f470-4959-8515-1b1ddfe471c0 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:59:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-47d38bee-2ae6-4132-83e2-c1259e9d70a9 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0" status: 404 len: 111 microversion: 2.1 time: 0.028553 Nov 28 06:59:06 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 327/992] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:59:06 2023] GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:59:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:06 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance af3a583a-f470-4959-8515-1b1ddfe471c0 could not be found. Nov 28 06:59:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance af3a583a-f470-4959-8515-1b1ddfe471c0 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:59:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-42b3b508-8c71-4044-93ca-19ccda2174b2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0" status: 404 len: 111 microversion: 2.1 time: 0.027345 Nov 28 06:59:06 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 337/993] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:59:06 2023] DELETE /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:59:06 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:06 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: af3a583a-f470-4959-8515-1b1ddfe471c0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:06 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance af3a583a-f470-4959-8515-1b1ddfe471c0 could not be found. Nov 28 06:59:06 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance af3a583a-f470-4959-8515-1b1ddfe471c0 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:59:06 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-eda58106-3e49-4574-b2eb-a549eacfe5dc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0" status: 404 len: 111 microversion: 2.1 time: 0.033835 Nov 28 06:59:06 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 330/994] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:59:06 2023] GET /compute/v2.1/servers/af3a583a-f470-4959-8515-1b1ddfe471c0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 06:59:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-82d73dca-6fef-4bee-9806-f5fc1ab28d0e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Action: 'create', calling method: .version_select at 0x7f0b03505120>, body: {"keypair": {"name": "tempest-keypair-6317093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw/bgJM7S7KTViraEzpff75LdAz+7XKA3V0OajZokvNlT8+UF+rFN68SYhnsA4uQlPYo6UuoIvnVGIHXMcO6dX9mYxRXnFeRY818AlVAV+XmpPx5B1+yb6wwqL2D5PHwg=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:17 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:17 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:17 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-82d73dca-6fef-4bee-9806-f5fc1ab28d0e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:59:17 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-82d73dca-6fef-4bee-9806-f5fc1ab28d0e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for user 2139976b453e4bd2b8e83e551a0cc772 and project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:59:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-82d73dca-6fef-4bee-9806-f5fc1ab28d0e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.062094 Nov 28 06:59:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 328/995] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 06:59:17 2023] POST /compute/v2.1/os-keypairs => generated 383 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:19 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1208701007", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "ed591127-ee7f-497d-9cfc-4cd2e691c235", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7d507ecb-7146-47b0-98b6-2939026c2b05"}], "security_groups": [{"name": "tempest-securitygroup--1201823590"}], "key_name": "tempest-keypair-6317093", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:19 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:19 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=24 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:19 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] validate_networks() for [('7d507ecb-7146-47b0-98b6-2939026c2b05', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for user 2139976b453e4bd2b8e83e551a0cc772 and project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 06:59:20 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed591127-ee7f-497d-9cfc-4cd2e691c235',volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 06:59:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1c19ec85-7c65-4c4b-8ba0-f789f2d4ef33 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.029324 Nov 28 06:59:20 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 338/996] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 06:59:19 2023] POST /compute/v2.1/servers => generated 404 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 06:59:20 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-57066270-6949-425b-8d4f-8a09f6df7f5b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:20 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-57066270-6949-425b-8d4f-8a09f6df7f5b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:20 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:20 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:20 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-57066270-6949-425b-8d4f-8a09f6df7f5b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:59:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-57066270-6949-425b-8d4f-8a09f6df7f5b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f" status: 200 len: 1085 microversion: 2.1 time: 0.076028 Nov 28 06:59:20 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 331/997] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:59:20 2023] GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f => generated 1085 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:59:22 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304574e5-b806-44dc-9302-cdce2822898f", "tag": "3eb0757a-68b5-4718-b270-812c217e9e86"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:22 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] Creating event network-changed:3eb0757a-68b5-4718-b270-812c217e9e86 for instance 304574e5-b806-44dc-9302-cdce2822898f on user Nov 28 06:59:22 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-d834f6f8-f5ff-4fed-8b61-da1a3d235037 req-973480ea-2361-4286-bef9-0fb24b71d34d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032016 Nov 28 06:59:22 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 329/998] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:59:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:26 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-fabe0a4d-d960-4122-aded-05ba95a8da8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:26 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-fabe0a4d-d960-4122-aded-05ba95a8da8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fabe0a4d-d960-4122-aded-05ba95a8da8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fabe0a4d-d960-4122-aded-05ba95a8da8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fabe0a4d-d960-4122-aded-05ba95a8da8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fabe0a4d-d960-4122-aded-05ba95a8da8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fabe0a4d-d960-4122-aded-05ba95a8da8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:26 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fabe0a4d-d960-4122-aded-05ba95a8da8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:26 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-fabe0a4d-d960-4122-aded-05ba95a8da8e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048233 Nov 28 06:59:26 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 339/999] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:59:26 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:59:26 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b44a9c37-a4be-4826-865a-4c179b185604 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:26 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-b44a9c37-a4be-4826-865a-4c179b185604 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b44a9c37-a4be-4826-865a-4c179b185604 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b44a9c37-a4be-4826-865a-4c179b185604 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b44a9c37-a4be-4826-865a-4c179b185604 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b44a9c37-a4be-4826-865a-4c179b185604 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b44a9c37-a4be-4826-865a-4c179b185604 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:26 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b44a9c37-a4be-4826-865a-4c179b185604 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:26 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-b44a9c37-a4be-4826-865a-4c179b185604 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046462 Nov 28 06:59:26 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 332/1000] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 06:59:26 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 06:59:26 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:26 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:26 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 06:59:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a628dfbe-e805-4fa8-9e6e-56db43eaaf62 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4" status: 204 len: 0 microversion: 2.1 time: 0.115591 Nov 28 06:59:27 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 330/1001] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 06:59:26 2023] DELETE /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 06:59:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-941b8bc4-78bc-4606-8018-780a0660b265 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:27 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-941b8bc4-78bc-4606-8018-780a0660b265 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-941b8bc4-78bc-4606-8018-780a0660b265 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-941b8bc4-78bc-4606-8018-780a0660b265 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-941b8bc4-78bc-4606-8018-780a0660b265 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-941b8bc4-78bc-4606-8018-780a0660b265 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-941b8bc4-78bc-4606-8018-780a0660b265 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-941b8bc4-78bc-4606-8018-780a0660b265 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:27 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-941b8bc4-78bc-4606-8018-780a0660b265 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fdd08d34954e97ae65ec1ce1c3d0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f8529212249d68a54698cffcdc44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:59:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-941b8bc4-78bc-4606-8018-780a0660b265 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4" status: 200 len: 1659 microversion: 2.1 time: 0.230866 Nov 28 06:59:27 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 340/1002] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:59:27 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4 => generated 1659 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:59:27 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e60471-f6da-476c-b0de-c729eec1b2b4", "name": "network-vif-unplugged", "status": "completed", "tag": "97da79b7-c41c-46da-8faa-03d072c630a6"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] Creating event network-vif-unplugged:97da79b7-c41c-46da-8faa-03d072c630a6 for instance 92e60471-f6da-476c-b0de-c729eec1b2b4 on user Nov 28 06:59:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-3f637081-ef9a-4947-ac95-5f908e86db1c req-84ce6ea4-6e0c-41dc-82db-7b7082532d00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027948 Nov 28 06:59:27 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 333/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:59:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 06:59:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e60471-f6da-476c-b0de-c729eec1b2b4", "name": "network-vif-plugged", "status": "completed", "tag": "97da79b7-c41c-46da-8faa-03d072c630a6"}, {"server_uuid": "92e60471-f6da-476c-b0de-c729eec1b2b4", "name": "network-vif-deleted", "tag": "97da79b7-c41c-46da-8faa-03d072c630a6"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:29 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] Creating event network-vif-plugged:97da79b7-c41c-46da-8faa-03d072c630a6 for instance 92e60471-f6da-476c-b0de-c729eec1b2b4 on user Nov 28 06:59:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] Creating event network-vif-deleted:97da79b7-c41c-46da-8faa-03d072c630a6 for instance 92e60471-f6da-476c-b0de-c729eec1b2b4 on user Nov 28 06:59:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-dd5bfa66-e656-416c-b0b5-ddd149ad278a req-ae51f1c7-9c91-4860-92b8-7d5abad268a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054475 Nov 28 06:59:29 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 331/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:32 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304574e5-b806-44dc-9302-cdce2822898f", "name": "network-vif-plugged", "status": "completed", "tag": "3eb0757a-68b5-4718-b270-812c217e9e86"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:32 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:32 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:32 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] Creating event network-vif-plugged:3eb0757a-68b5-4718-b270-812c217e9e86 for instance 304574e5-b806-44dc-9302-cdce2822898f on user Nov 28 06:59:32 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-3522ff69-97fa-4401-acb4-51328d5aafe2 req-6faea81d-b19a-472c-9f3c-46c3d3fdd142 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050491 Nov 28 06:59:32 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 341/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:59:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:32 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:32 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-60c17781-c054-4710-ae74-672ef6e16cb8 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:32 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-60c17781-c054-4710-ae74-672ef6e16cb8 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60c17781-c054-4710-ae74-672ef6e16cb8 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60c17781-c054-4710-ae74-672ef6e16cb8 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60c17781-c054-4710-ae74-672ef6e16cb8 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60c17781-c054-4710-ae74-672ef6e16cb8 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60c17781-c054-4710-ae74-672ef6e16cb8 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:32 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-60c17781-c054-4710-ae74-672ef6e16cb8 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:32 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-60c17781-c054-4710-ae74-672ef6e16cb8 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "GET /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.218365 Nov 28 06:59:32 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 334/1006] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 06:59:32 2023] GET /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/os-interface => generated 282 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:33 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90e15ebf-04e6-4180-84e5-32f2d8233f31", "device": "/dev/vdb"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:33 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:33 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-24c37be7-76eb-42e3-8a82-36111d457dcc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "POST /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280257 Nov 28 06:59:33 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 332/1007] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 06:59:33 2023] POST /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:34 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304574e5-b806-44dc-9302-cdce2822898f", "name": "network-vif-plugged", "status": "completed", "tag": "3eb0757a-68b5-4718-b270-812c217e9e86"}, {"name": "network-changed", "server_uuid": "572ab6e9-7bbc-44ad-9e20-c53c17ed333f", "tag": "e801ef0c-430d-49ef-8691-ef7c7678c8c5"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:34 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Creating event network-vif-plugged:3eb0757a-68b5-4718-b270-812c217e9e86 for instance 304574e5-b806-44dc-9302-cdce2822898f on user Nov 28 06:59:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] Creating event network-changed:e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f on user Nov 28 06:59:34 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-2a8253e4-0222-4c7d-b073-aa6fd493046d req-0bdaad61-b341-42e4-bf2a-7284b9a256e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064044 Nov 28 06:59:34 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 342/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 06:59:34 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 06:59:39 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:39 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:40 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:59:40 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:59:40 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:59:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-2275b515-78c1-43db-aa51-6fc7f5ab0c93 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 200 len: 1586 microversion: 2.20 time: 0.269361 Nov 28 06:59:40 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 335/1009] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 06:59:39 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 1586 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d9301ab2-29c2-4123-9cd2-f636dc3aa33c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d9301ab2-29c2-4123-9cd2-f636dc3aa33c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9301ab2-29c2-4123-9cd2-f636dc3aa33c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9301ab2-29c2-4123-9cd2-f636dc3aa33c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9301ab2-29c2-4123-9cd2-f636dc3aa33c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9301ab2-29c2-4123-9cd2-f636dc3aa33c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9301ab2-29c2-4123-9cd2-f636dc3aa33c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d9301ab2-29c2-4123-9cd2-f636dc3aa33c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:46 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d9301ab2-29c2-4123-9cd2-f636dc3aa33c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:59:47 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d9301ab2-29c2-4123-9cd2-f636dc3aa33c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 200 len: 1547 microversion: 2.1 time: 0.431094 Nov 28 06:59:47 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 333/1010] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:59:46 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 1547 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:59:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=18 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 06:59:47 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-325c7fe4-6af8-4b1e-b4ba-187db3297ecf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 06:59:47 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-325c7fe4-6af8-4b1e-b4ba-187db3297ecf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-325c7fe4-6af8-4b1e-b4ba-187db3297ecf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-325c7fe4-6af8-4b1e-b4ba-187db3297ecf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-325c7fe4-6af8-4b1e-b4ba-187db3297ecf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-325c7fe4-6af8-4b1e-b4ba-187db3297ecf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-325c7fe4-6af8-4b1e-b4ba-187db3297ecf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-325c7fe4-6af8-4b1e-b4ba-187db3297ecf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-325c7fe4-6af8-4b1e-b4ba-187db3297ecf tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "POST /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad/action" status: 200 len: 32224 microversion: 2.1 time: 0.225112 Nov 28 06:59:47 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 343/1011] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 06:59:47 2023] POST /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad/action => generated 32224 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 06:59:47 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-596f2942-dd14-49db-933f-736bbfc961aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:47 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-596f2942-dd14-49db-933f-736bbfc961aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-596f2942-dd14-49db-933f-736bbfc961aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-596f2942-dd14-49db-933f-736bbfc961aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-596f2942-dd14-49db-933f-736bbfc961aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-596f2942-dd14-49db-933f-736bbfc961aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-596f2942-dd14-49db-933f-736bbfc961aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-596f2942-dd14-49db-933f-736bbfc961aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:47 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-596f2942-dd14-49db-933f-736bbfc961aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 06:59:47 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-596f2942-dd14-49db-933f-736bbfc961aa tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1540 microversion: 2.1 time: 0.198539 Nov 28 06:59:47 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 336/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:59:47 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1540 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 06:59:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 06:59:50 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] [instance: 038840e0-306b-466b-8dea-75d8cf2ea261] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 06:59:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 06:59:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 06:59:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 06:59:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] HTTP exception thrown: Instance 038840e0-306b-466b-8dea-75d8cf2ea261 could not be found. Nov 28 06:59:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] Returning 404 to user: Instance 038840e0-306b-466b-8dea-75d8cf2ea261 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 06:59:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-53f2f25c-f8f4-440f-88b5-8920a6fde0c6 tempest-VolumesNegativeTest-1469243564 tempest-VolumesNegativeTest-1469243564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/038840e0-306b-466b-8dea-75d8cf2ea261" status: 404 len: 111 microversion: 2.1 time: 0.028068 Nov 28 06:59:50 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 334/1013] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 06:59:50 2023] GET /compute/v2.1/servers/038840e0-306b-466b-8dea-75d8cf2ea261 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:00:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:04 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:05 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:05 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'services' on Instance uuid 572ab6e9-7bbc-44ad-9e20-c53c17ed333f {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:00:05 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-3f2e23f9-3ee0-42e7-a300-de08aa8bd5d7 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/os-volume_attachments/90e15ebf-04e6-4180-84e5-32f2d8233f31" status: 202 len: 0 microversion: 2.1 time: 0.173671 Nov 28 07:00:05 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 344/1014] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:00:04 2023] DELETE /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f/os-volume_attachments/90e15ebf-04e6-4180-84e5-32f2d8233f31 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=14 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=24 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:05 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:00:05 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e3826ec5-a86c-4b5e-b3a7-f1b9585022c1 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f" status: 204 len: 0 microversion: 2.1 time: 0.152447 Nov 28 07:00:05 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 337/1015] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:00:05 2023] DELETE /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c490b348-0559-44e8-9191-010b0d0c77b9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c490b348-0559-44e8-9191-010b0d0c77b9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=8 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c490b348-0559-44e8-9191-010b0d0c77b9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c490b348-0559-44e8-9191-010b0d0c77b9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c490b348-0559-44e8-9191-010b0d0c77b9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c490b348-0559-44e8-9191-010b0d0c77b9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c490b348-0559-44e8-9191-010b0d0c77b9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c490b348-0559-44e8-9191-010b0d0c77b9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:05 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-c490b348-0559-44e8-9191-010b0d0c77b9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eb76cab93f4dfd97bf85828d89df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82be9b17ed614b8aa2bb7172eedf516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:00:05 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c490b348-0559-44e8-9191-010b0d0c77b9 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "GET /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f" status: 200 len: 1713 microversion: 2.1 time: 0.213429 Nov 28 07:00:05 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 335/1016] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:00:05 2023] GET /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f => generated 1713 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:00:10 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f4ef5aeb-0862-4ce9-8045-8a152d2603a6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:10 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f4ef5aeb-0862-4ce9-8045-8a152d2603a6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4ef5aeb-0862-4ce9-8045-8a152d2603a6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4ef5aeb-0862-4ce9-8045-8a152d2603a6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4ef5aeb-0862-4ce9-8045-8a152d2603a6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4ef5aeb-0862-4ce9-8045-8a152d2603a6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4ef5aeb-0862-4ce9-8045-8a152d2603a6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f4ef5aeb-0862-4ce9-8045-8a152d2603a6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:10 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-f4ef5aeb-0862-4ce9-8045-8a152d2603a6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:00:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f4ef5aeb-0862-4ce9-8045-8a152d2603a6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f" status: 200 len: 1439 microversion: 2.1 time: 0.211762 Nov 28 07:00:10 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 345/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:00:10 2023] GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f => generated 1439 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] HTTP exception thrown: Instance 92e60471-f6da-476c-b0de-c729eec1b2b4 could not be found. Nov 28 07:00:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Returning 404 to user: Instance 92e60471-f6da-476c-b0de-c729eec1b2b4 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:00:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1547846e-bde1-4f10-bee4-0e9a5de3f58e tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4" status: 404 len: 111 microversion: 2.1 time: 0.036199 Nov 28 07:00:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 338/1018] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:00:17 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:00:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-42f99ecf-3867-414f-99db-9bd5a4986395 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '.version_select at 0x7f0b03505bd0>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:17 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:17 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-42f99ecf-3867-414f-99db-9bd5a4986395 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-34936543" status: 202 len: 0 microversion: 2.1 time: 0.022659 Nov 28 07:00:17 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 336/1019] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Nov 28 07:00:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-34936543 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:24 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] HTTP exception thrown: Instance 92e60471-f6da-476c-b0de-c729eec1b2b4 could not be found. Nov 28 07:00:24 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Returning 404 to user: Instance 92e60471-f6da-476c-b0de-c729eec1b2b4 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:00:24 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a95d6425-1d93-47d8-8bd3-75950d7650c2 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4" status: 404 len: 111 microversion: 2.1 time: 0.047200 Nov 28 07:00:24 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 346/1020] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:00:24 2023] DELETE /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:00:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:24 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: 92e60471-f6da-476c-b0de-c729eec1b2b4] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] HTTP exception thrown: Instance 92e60471-f6da-476c-b0de-c729eec1b2b4 could not be found. Nov 28 07:00:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Returning 404 to user: Instance 92e60471-f6da-476c-b0de-c729eec1b2b4 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:00:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-fc545074-7a9a-4146-a8ef-a07e7297c316 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4" status: 404 len: 111 microversion: 2.1 time: 0.031247 Nov 28 07:00:24 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 339/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:00:24 2023] GET /compute/v2.1/servers/92e60471-f6da-476c-b0de-c729eec1b2b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:00:27 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ab6e9-7bbc-44ad-9e20-c53c17ed333f", "name": "network-vif-unplugged", "status": "completed", "tag": "e801ef0c-430d-49ef-8691-ef7c7678c8c5"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:00:27 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] Creating event network-vif-unplugged:e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f on user Nov 28 07:00:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-e5a270ae-feeb-4f79-b691-17e1a69b4eaf req-c6ebc0b0-4077-45e8-8222-9aa8f8b7228d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032951 Nov 28 07:00:27 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 337/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:00:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 07:00:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:27 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] HTTP exception thrown: Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d could not be found. Nov 28 07:00:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Returning 404 to user: Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:00:27 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-dfd5ccc0-294a-4976-96d4-f2973a3a4a73 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 404 len: 111 microversion: 2.1 time: 0.030698 Nov 28 07:00:27 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 347/1023] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:00:27 2023] DELETE /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:00:27 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:27 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] [instance: bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] HTTP exception thrown: Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d could not be found. Nov 28 07:00:27 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] Returning 404 to user: Instance bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:00:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-db24cd25-44eb-40ee-b493-d9ca3dd6eb44 tempest-AttachVolumeTestJSON-25504685 tempest-AttachVolumeTestJSON-25504685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d" status: 404 len: 111 microversion: 2.1 time: 0.027148 Nov 28 07:00:27 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 340/1024] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:00:27 2023] GET /compute/v2.1/servers/bcd4a3fe-bb9f-43b7-9d4d-c473c6117f6d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:00:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ab6e9-7bbc-44ad-9e20-c53c17ed333f", "name": "network-vif-plugged", "status": "completed", "tag": "e801ef0c-430d-49ef-8691-ef7c7678c8c5"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:00:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] Creating event network-vif-plugged:e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f on user Nov 28 07:00:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-0298ac92-84df-46f1-b316-362646a8460d req-88363006-8cb1-4fb6-aba9-85827f4ab050 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039933 Nov 28 07:00:29 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 338/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:00:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:00:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-ae64ac64-63b8-427e-a156-6ad3673db4e8 req-bbc86cb0-b260-44c5-8b5d-757882931ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ab6e9-7bbc-44ad-9e20-c53c17ed333f", "name": "network-vif-deleted", "tag": "e801ef0c-430d-49ef-8691-ef7c7678c8c5"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:00:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ae64ac64-63b8-427e-a156-6ad3673db4e8 req-bbc86cb0-b260-44c5-8b5d-757882931ae6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ae64ac64-63b8-427e-a156-6ad3673db4e8 req-bbc86cb0-b260-44c5-8b5d-757882931ae6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ae64ac64-63b8-427e-a156-6ad3673db4e8 req-bbc86cb0-b260-44c5-8b5d-757882931ae6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ae64ac64-63b8-427e-a156-6ad3673db4e8 req-bbc86cb0-b260-44c5-8b5d-757882931ae6 service nova] Creating event network-vif-deleted:e801ef0c-430d-49ef-8691-ef7c7678c8c5 for instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f on user Nov 28 07:00:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-ae64ac64-63b8-427e-a156-6ad3673db4e8 req-bbc86cb0-b260-44c5-8b5d-757882931ae6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083453 Nov 28 07:00:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 348/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:00:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:00:40 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9bf15f5b-8bf1-41eb-9891-99b527ce2d40 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:40 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9bf15f5b-8bf1-41eb-9891-99b527ce2d40 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:40 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:40 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9bf15f5b-8bf1-41eb-9891-99b527ce2d40 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9bf15f5b-8bf1-41eb-9891-99b527ce2d40 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9bf15f5b-8bf1-41eb-9891-99b527ce2d40 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9bf15f5b-8bf1-41eb-9891-99b527ce2d40 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9bf15f5b-8bf1-41eb-9891-99b527ce2d40 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9bf15f5b-8bf1-41eb-9891-99b527ce2d40 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9bf15f5b-8bf1-41eb-9891-99b527ce2d40 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.160144 Nov 28 07:00:40 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 341/1027] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 07:00:40 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/os-interface => generated 283 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 07:00:41 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:41 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:41 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:00:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] Creating event network-changed:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 07:00:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-49cf17d3-a2be-4f1d-8232-505093619530 req-dca6296e-62ff-437e-b3bf-494256f66cc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034391 Nov 28 07:00:41 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 339/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:00:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:00:42 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:42 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:00:42 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-859ec538-39aa-410e-b66b-4753825d7334 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:42 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-859ec538-39aa-410e-b66b-4753825d7334 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-859ec538-39aa-410e-b66b-4753825d7334 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-859ec538-39aa-410e-b66b-4753825d7334 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-859ec538-39aa-410e-b66b-4753825d7334 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-859ec538-39aa-410e-b66b-4753825d7334 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-859ec538-39aa-410e-b66b-4753825d7334 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:42 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-859ec538-39aa-410e-b66b-4753825d7334 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:42 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-859ec538-39aa-410e-b66b-4753825d7334 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/ips" status: 200 len: 150 microversion: 2.20 time: 0.084827 Nov 28 07:00:42 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 349/1029] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 28 07:00:42 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/ips => generated 150 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 07:00:45 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:00:45 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:45 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lazy-loading 'flavor' on Instance uuid 57d4327e-1732-4e71-be0d-05ae08e312b5 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:00:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-8d5920f1-4914-4b46-a6f3-b64e489825c5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "POST /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/action" status: 202 len: 0 microversion: 2.20 time: 0.974837 Nov 28 07:00:46 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 342/1030] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 07:00:45 2023] POST /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/action => generated 0 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:00:46 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:00:46 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-305ac471-c208-4fb7-a00e-fd3374e011a5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 200 len: 1711 microversion: 2.20 time: 0.258854 Nov 28 07:00:46 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 340/1031] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 07:00:46 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 1711 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 07:00:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "name": "network-vif-unplugged", "status": "completed", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:00:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] Creating event network-vif-unplugged:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 07:00:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-cbd5b818-1399-4cd5-b5fb-008cf377557e req-5f5184dc-8eb6-4cda-bb7f-cd7a65aedda9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.200851 Nov 28 07:00:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 350/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:00:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:00:47 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:47 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:47 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:00:47 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-756c60cc-643a-4bcf-b3bd-20460fa65a25 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 204 len: 0 microversion: 2.1 time: 0.160377 Nov 28 07:00:47 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 343/1033] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:00:47 2023] DELETE /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:00:47 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-042278de-2d7c-42b2-8136-22ead43bffc0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:47 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-042278de-2d7c-42b2-8136-22ead43bffc0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-042278de-2d7c-42b2-8136-22ead43bffc0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-042278de-2d7c-42b2-8136-22ead43bffc0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-042278de-2d7c-42b2-8136-22ead43bffc0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-042278de-2d7c-42b2-8136-22ead43bffc0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-042278de-2d7c-42b2-8136-22ead43bffc0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-042278de-2d7c-42b2-8136-22ead43bffc0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:48 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-042278de-2d7c-42b2-8136-22ead43bffc0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:00:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-042278de-2d7c-42b2-8136-22ead43bffc0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 200 len: 1553 microversion: 2.1 time: 0.290373 Nov 28 07:00:48 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 341/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:00:47 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 1553 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:00:48 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "name": "network-vif-unplugged", "status": "completed", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:00:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:48 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:48 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] Creating event network-vif-unplugged:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 07:00:48 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-f5ebc9fb-9b69-4ca9-830d-8a0660d8a67f req-98c5814d-0ee5-482c-9fd8-ca5eeca60486 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047977 Nov 28 07:00:48 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 351/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:00:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:00:48 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "name": "network-vif-plugged", "status": "completed", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:00:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:48 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:48 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] Creating event network-vif-plugged:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 07:00:48 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-238ace58-33e2-4b26-b5c1-43d15c7031b0 req-d5bacd47-708a-41c5-9a9e-b1b8590b8c0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028577 Nov 28 07:00:48 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 344/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:00:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:00:50 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "name": "network-vif-plugged", "status": "completed", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}, {"server_uuid": "edb101d9-028e-4191-84a2-1169555a21ad", "name": "network-vif-deleted", "tag": "9931d17e-bd7c-4a94-a98b-347ac890bcc2"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:00:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:50 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] Creating event network-vif-plugged:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 07:00:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] Creating event network-vif-deleted:9931d17e-bd7c-4a94-a98b-347ac890bcc2 for instance edb101d9-028e-4191-84a2-1169555a21ad on user Nov 28 07:00:50 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-6968feb3-da0f-4254-8eb2-e76601c3a19b req-da3459fa-148a-4e2b-8d21-7bc827d1d5fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050657 Nov 28 07:00:50 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 342/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:00:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:00:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:00:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] Creating event network-changed:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 07:00:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-d01bd8c2-50a9-46ef-868f-6ad3f885bd6e req-a58b18df-64e4-43db-88c2-d738d9c63773 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035617 Nov 28 07:00:52 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 352/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:00:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:00:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:55 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: 572ab6e9-7bbc-44ad-9e20-c53c17ed333f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:00:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:00:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:00:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:00:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] HTTP exception thrown: Instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f could not be found. Nov 28 07:00:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Returning 404 to user: Instance 572ab6e9-7bbc-44ad-9e20-c53c17ed333f could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:00:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-ae66f1bd-30b3-4898-bf05-56719199714b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "GET /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f" status: 404 len: 111 microversion: 2.1 time: 0.033123 Nov 28 07:00:55 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 345/1039] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:00:55 2023] GET /compute/v2.1/servers/572ab6e9-7bbc-44ad-9e20-c53c17ed333f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:00:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-0df7510c-11c1-4b37-8e74-81062d139c5d tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '.version_select at 0x7f0b03506710>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:00:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-0df7510c-11c1-4b37-8e74-81062d139c5d tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-536756227" status: 202 len: 0 microversion: 2.1 time: 0.025512 Nov 28 07:00:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 343/1040] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 07:00:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-536756227 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:01:09 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-ec73358d-f638-4968-b70b-a1887263904e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Action: 'create', calling method: .version_select at 0x7f0b0375eef0>, body: {"keypair": {"name": "tempest-keypair-74843823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILnZ2bSYD7C7qQpY3V/IJDltBTIc6Dlzb+LlSUgAknlnhIs7hnELxdz9TrmSJPvyqkS7nZGtlgdt6xLyjIWPLsz31+3N20PY9yNf3/tdKzT6WIf/5v0Co0KV5lMCJu2/A=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:09 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=8 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:09 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=10 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:09 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-ec73358d-f638-4968-b70b-a1887263904e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting quotas for project 82be9b17ed614b8aa2bb7172eedf516e. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:01:09 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-ec73358d-f638-4968-b70b-a1887263904e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting quotas for user 37eb76cab93f4dfd97bf85828d89df68 and project 82be9b17ed614b8aa2bb7172eedf516e. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:01:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-ec73358d-f638-4968-b70b-a1887263904e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.065999 Nov 28 07:01:09 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 353/1041] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 07:01:09 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:01:10 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-936aab8c-02b1-4b32-8db5-e716231ac439 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:01:10 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-936aab8c-02b1-4b32-8db5-e716231ac439 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:10 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:10 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-936aab8c-02b1-4b32-8db5-e716231ac439 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-936aab8c-02b1-4b32-8db5-e716231ac439 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-936aab8c-02b1-4b32-8db5-e716231ac439 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-936aab8c-02b1-4b32-8db5-e716231ac439 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-936aab8c-02b1-4b32-8db5-e716231ac439 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-936aab8c-02b1-4b32-8db5-e716231ac439 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:10 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-936aab8c-02b1-4b32-8db5-e716231ac439 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.146348 Nov 28 07:01:10 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 346/1042] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 07:01:10 2023] GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f/os-interface => generated 283 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:01:11 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=16 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:11 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:11 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-187360494", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "networks": [{"uuid": "e362119a-300d-496b-a211-8b1a13b2edf8"}], "security_groups": [{"name": "tempest-securitygroup--1407933166"}], "key_name": "tempest-keypair-74843823", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:11 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] validate_networks() for [('e362119a-300d-496b-a211-8b1a13b2edf8', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304574e5-b806-44dc-9302-cdce2822898f", "tag": "3eb0757a-68b5-4718-b270-812c217e9e86"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:11 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] Creating event network-changed:3eb0757a-68b5-4718-b270-812c217e9e86 for instance 304574e5-b806-44dc-9302-cdce2822898f on user Nov 28 07:01:11 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-5feab334-7888-4ba4-b3d6-686572e39df1 req-978bd092-e40f-42a7-80b0-88162841f054 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040617 Nov 28 07:01:11 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 354/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:01:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:01:11 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-278c94cf-eec3-40e9-88d1-200b391d7ee2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:01:11 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-278c94cf-eec3-40e9-88d1-200b391d7ee2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-278c94cf-eec3-40e9-88d1-200b391d7ee2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-278c94cf-eec3-40e9-88d1-200b391d7ee2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-278c94cf-eec3-40e9-88d1-200b391d7ee2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-278c94cf-eec3-40e9-88d1-200b391d7ee2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-278c94cf-eec3-40e9-88d1-200b391d7ee2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-278c94cf-eec3-40e9-88d1-200b391d7ee2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:11 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-278c94cf-eec3-40e9-88d1-200b391d7ee2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:01:11 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-278c94cf-eec3-40e9-88d1-200b391d7ee2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f" status: 200 len: 1439 microversion: 2.1 time: 0.152858 Nov 28 07:01:11 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 347/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:01:11 2023] GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f => generated 1439 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-883024175"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:12 user devstack@n-api.service[64872]: INFO nova.compute.api [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Attempting to quiesce instance before volume snapshot. Nov 28 07:01:12 user devstack@n-api.service[64872]: INFO nova.compute.api [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Skipping quiescing instance: QEMU guest agent is not enabled. Nov 28 07:01:12 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Creating snapshot from volume ed591127-ee7f-497d-9cfc-4cd2e691c235. {{(pid=64872) snapshot_instance /opt/stack/nova/nova/compute/api.py:3512}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting quotas for project 82be9b17ed614b8aa2bb7172eedf516e. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Getting quotas for user 37eb76cab93f4dfd97bf85828d89df68 and project 82be9b17ed614b8aa2bb7172eedf516e. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 07:01:12 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 07:01:12 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-a69925c9-4a3d-467d-b18a-83ee12912c79 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.356432 Nov 28 07:01:12 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 344/1045] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 07:01:11 2023] POST /compute/v2.1/servers => generated 404 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 07:01:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-fddb786f-6bc1-4499-bdf4-bd8f71d10511 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:01:12 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-fddb786f-6bc1-4499-bdf4-bd8f71d10511 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:12 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-fddb786f-6bc1-4499-bdf4-bd8f71d10511 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eb76cab93f4dfd97bf85828d89df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82be9b17ed614b8aa2bb7172eedf516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:01:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-fddb786f-6bc1-4499-bdf4-bd8f71d10511 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296" status: 200 len: 1232 microversion: 2.1 time: 0.063366 Nov 28 07:01:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 348/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:01:12 2023] GET /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296 => generated 1232 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:01:14 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69564a5-bf33-41a2-bc28-9bf7950be296", "tag": "6e515013-115b-4ad7-9ffb-f4aebd5cca06"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:14 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:14 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] Creating event network-changed:6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance f69564a5-bf33-41a2-bc28-9bf7950be296 on user Nov 28 07:01:14 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-92d785af-a41f-474a-a994-32cc3a7a9472 req-75dd5501-cdc6-42a5-8827-3e0ca90bd6f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030185 Nov 28 07:01:14 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 345/1047] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:01:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:01:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-906d715b-1ba8-44aa-92ed-cfe5977c8445 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "POST /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f/action" status: 202 len: 0 microversion: 2.1 time: 3.030858 Nov 28 07:01:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 355/1048] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 07:01:11 2023] POST /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f/action => generated 0 bytes in 3033 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 07:01:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-35dda0a0-930d-4405-8d3f-1ce31c370a5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Action: 'create', calling method: .version_select at 0x7f0b038bd5a0>, body: {"keypair": {"name": "tempest-keypair-966967716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3yEiDYiUs/P5zKldbzJkovtF3EfJjvSuKt4/cua9dAZ7JiOcjNDIYOsr3PpzJvb5uB9NS9ux76qjy+rXD0s67lGDl07aeLGETyT5WUfbmW7fYH0T2knTlco6MKFAF0OA=="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:16 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-35dda0a0-930d-4405-8d3f-1ce31c370a5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:01:16 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-35dda0a0-930d-4405-8d3f-1ce31c370a5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for user 2139976b453e4bd2b8e83e551a0cc772 and project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:01:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-35dda0a0-930d-4405-8d3f-1ce31c370a5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042936 Nov 28 07:01:16 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 349/1049] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 07:01:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:01:16 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69564a5-bf33-41a2-bc28-9bf7950be296", "name": "network-vif-plugged", "status": "completed", "tag": "6e515013-115b-4ad7-9ffb-f4aebd5cca06"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] Creating event network-vif-plugged:6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance f69564a5-bf33-41a2-bc28-9bf7950be296 on user Nov 28 07:01:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-c2dbaf2a-ae82-44bc-a2c3-15b9e2f80b39 req-833f6de6-8a07-4fb9-bac4-ad1ea623c94e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054698 Nov 28 07:01:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 346/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:01:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:01:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-985455269", "imageRef": "9b35b5bc-a710-492d-93aa-ae06b4ac29b6", "flavorRef": "1", "networks": [{"uuid": "7d507ecb-7146-47b0-98b6-2939026c2b05"}], "security_groups": [{"name": "tempest-securitygroup--775151853"}], "key_name": "tempest-keypair-966967716", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:17 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] validate_networks() for [('7d507ecb-7146-47b0-98b6-2939026c2b05', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for user 2139976b453e4bd2b8e83e551a0cc772 and project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 07:01:18 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='34565803-1982-4f51-b00f-e0784ea16e65',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 07:01:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-49bd0e8d-edf8-4e7c-94ff-5f12e031d658 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.585401 Nov 28 07:01:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 356/1051] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 07:01:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 07:01:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-f0f677b8-4bf8-4d46-bf0e-363eaf1a813a tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:01:18 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-f0f677b8-4bf8-4d46-bf0e-363eaf1a813a tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:18 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-f0f677b8-4bf8-4d46-bf0e-363eaf1a813a tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:01:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-f0f677b8-4bf8-4d46-bf0e-363eaf1a813a tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" status: 200 len: 1244 microversion: 2.1 time: 0.055757 Nov 28 07:01:18 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 350/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:01:18 2023] GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a => generated 1244 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:01:18 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69564a5-bf33-41a2-bc28-9bf7950be296", "name": "network-vif-plugged", "status": "completed", "tag": "6e515013-115b-4ad7-9ffb-f4aebd5cca06"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:18 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] Creating event network-vif-plugged:6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance f69564a5-bf33-41a2-bc28-9bf7950be296 on user Nov 28 07:01:18 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-e2940393-3afc-4cf4-9ac5-0183add2010c req-c55559ec-5a71-4b97-890a-01724f334c5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032156 Nov 28 07:01:18 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 347/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:01:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:01:20 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a", "tag": "039674ae-aa8d-4194-a82a-0522d98a3e94"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] Creating event network-changed:039674ae-aa8d-4194-a82a-0522d98a3e94 for instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a on user Nov 28 07:01:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-f5bec592-155a-4f2a-be19-da5a84dc1197 req-53b0219a-ae42-4d87-a32f-e455feed7c4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036665 Nov 28 07:01:20 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 357/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:01:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:01:35 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a", "name": "network-vif-plugged", "status": "completed", "tag": "039674ae-aa8d-4194-a82a-0522d98a3e94"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:35 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=10 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:35 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:35 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=8 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:35 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] Creating event network-vif-plugged:039674ae-aa8d-4194-a82a-0522d98a3e94 for instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a on user Nov 28 07:01:35 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-0927f748-df1d-4b70-9320-d647618fb0f5 req-cdf82bb6-5f6b-42b9-978d-25e3fe877037 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033543 Nov 28 07:01:35 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 351/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:01:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=8 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:36 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:37 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:01:37 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:01:37 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:01:37 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b6fd8dd6-485b-4118-a294-da260c7f2bc6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 200 len: 1652 microversion: 2.20 time: 0.211542 Nov 28 07:01:37 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 348/1056] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 07:01:36 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 1652 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 07:01:37 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:37 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=10 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:37 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:37 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:01:37 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a", "name": "network-vif-plugged", "status": "completed", "tag": "039674ae-aa8d-4194-a82a-0522d98a3e94"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:37 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] Creating event network-vif-plugged:039674ae-aa8d-4194-a82a-0522d98a3e94 for instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a on user Nov 28 07:01:37 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-dbe539c8-bb97-485c-86c5-451b35b36b1a req-6e90ea12-aff1-499b-bb31-41695c894ddd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045285 Nov 28 07:01:37 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 358/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:01:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:01:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:01:38 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] HTTP exception thrown: Instance edb101d9-028e-4191-84a2-1169555a21ad could not be found. Nov 28 07:01:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Returning 404 to user: Instance edb101d9-028e-4191-84a2-1169555a21ad could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:01:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-abf141ae-c05f-4bbb-b672-329fb51acdd4 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 404 len: 111 microversion: 2.1 time: 0.030473 Nov 28 07:01:38 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 352/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:01:38 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:01:38 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:01:38 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] HTTP exception thrown: Instance edb101d9-028e-4191-84a2-1169555a21ad could not be found. Nov 28 07:01:38 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Returning 404 to user: Instance edb101d9-028e-4191-84a2-1169555a21ad could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:01:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-64a1eb5f-ef92-4e7a-867b-07d17a3bbe7c tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 404 len: 111 microversion: 2.1 time: 0.027226 Nov 28 07:01:38 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 349/1059] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:01:38 2023] DELETE /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:01:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:01:38 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: edb101d9-028e-4191-84a2-1169555a21ad] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] HTTP exception thrown: Instance edb101d9-028e-4191-84a2-1169555a21ad could not be found. Nov 28 07:01:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Returning 404 to user: Instance edb101d9-028e-4191-84a2-1169555a21ad could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:01:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-fc51d813-7e24-41d0-bf95-864a7a8172e0 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad" status: 404 len: 111 microversion: 2.1 time: 0.041583 Nov 28 07:01:38 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 359/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:01:38 2023] GET /compute/v2.1/servers/edb101d9-028e-4191-84a2-1169555a21ad => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:01:42 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:01:42 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:42 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:42 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:01:42 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-89dc633a-5da3-41e0-9bb6-4aab68186d42 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 204 len: 0 microversion: 2.1 time: 0.119235 Nov 28 07:01:42 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 353/1061] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:01:42 2023] DELETE /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 28 07:01:42 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-113a3292-5304-4989-8112-f3215c11bc41 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:01:42 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-113a3292-5304-4989-8112-f3215c11bc41 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:01:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-113a3292-5304-4989-8112-f3215c11bc41 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-113a3292-5304-4989-8112-f3215c11bc41 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-113a3292-5304-4989-8112-f3215c11bc41 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-113a3292-5304-4989-8112-f3215c11bc41 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-113a3292-5304-4989-8112-f3215c11bc41 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:42 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-113a3292-5304-4989-8112-f3215c11bc41 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:43 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-113a3292-5304-4989-8112-f3215c11bc41 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b9a26798e14399ac1a70568432485e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf9caaf7cab4c0eb3343ea2c2501481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:01:43 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-113a3292-5304-4989-8112-f3215c11bc41 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 200 len: 1546 microversion: 2.1 time: 0.441853 Nov 28 07:01:43 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 350/1062] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:01:42 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 1546 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:01:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e69254a-5914-4e90-ae6e-bdf28ac716e7", "name": "network-vif-unplugged", "status": "completed", "tag": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] Creating event network-vif-unplugged:29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 on user Nov 28 07:01:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-614c3e2f-6f21-49e0-a09a-d79b157af427 req-730712e1-110f-4db3-8923-6072c124ee01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.250471 Nov 28 07:01:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 360/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:01:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 07:01:45 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e69254a-5914-4e90-ae6e-bdf28ac716e7", "name": "network-vif-plugged", "status": "completed", "tag": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9"}, {"server_uuid": "5e69254a-5914-4e90-ae6e-bdf28ac716e7", "name": "network-vif-deleted", "tag": "29bc4fb8-446c-405d-a18f-e0bf5bc21fc9"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:01:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:01:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:01:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:01:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] Creating event network-vif-plugged:29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 on user Nov 28 07:01:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] Creating event network-vif-deleted:29bc4fb8-446c-405d-a18f-e0bf5bc21fc9 for instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 on user Nov 28 07:01:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-4ac1766f-50e5-4449-8690-78b1602cf6c6 req-7c466738-4e16-4331-ab51-4449844067a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050643 Nov 28 07:01:45 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 354/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:01:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d43a0968-3e42-436a-820f-9ea543244adc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d43a0968-3e42-436a-820f-9ea543244adc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=14 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d43a0968-3e42-436a-820f-9ea543244adc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d43a0968-3e42-436a-820f-9ea543244adc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d43a0968-3e42-436a-820f-9ea543244adc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d43a0968-3e42-436a-820f-9ea543244adc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d43a0968-3e42-436a-820f-9ea543244adc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d43a0968-3e42-436a-820f-9ea543244adc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:02 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-d43a0968-3e42-436a-820f-9ea543244adc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eb76cab93f4dfd97bf85828d89df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82be9b17ed614b8aa2bb7172eedf516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:02:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d43a0968-3e42-436a-820f-9ea543244adc tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296" status: 200 len: 1541 microversion: 2.1 time: 0.201332 Nov 28 07:02:02 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 351/1065] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:02:02 2023] GET /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296 => generated 1541 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f8c47b97-c027-4860-9763-db5ad552ce54 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f8c47b97-c027-4860-9763-db5ad552ce54 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f8c47b97-c027-4860-9763-db5ad552ce54 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f8c47b97-c027-4860-9763-db5ad552ce54 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f8c47b97-c027-4860-9763-db5ad552ce54 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f8c47b97-c027-4860-9763-db5ad552ce54 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f8c47b97-c027-4860-9763-db5ad552ce54 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f8c47b97-c027-4860-9763-db5ad552ce54 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:08 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-f8c47b97-c027-4860-9763-db5ad552ce54 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:02:08 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f8c47b97-c027-4860-9763-db5ad552ce54 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" status: 200 len: 1596 microversion: 2.1 time: 0.216967 Nov 28 07:02:08 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 361/1066] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:02:08 2023] GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a => generated 1596 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] [instance: 5e69254a-5914-4e90-ae6e-bdf28ac716e7] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:33 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] HTTP exception thrown: Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 could not be found. Nov 28 07:02:33 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Returning 404 to user: Instance 5e69254a-5914-4e90-ae6e-bdf28ac716e7 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:02:33 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-b0ab86ae-72f8-47a6-8f71-6a769cc02627 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7" status: 404 len: 111 microversion: 2.1 time: 0.039066 Nov 28 07:02:33 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 355/1067] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:02:33 2023] GET /compute/v2.1/servers/5e69254a-5914-4e90-ae6e-bdf28ac716e7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:02:33 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-676b1695-5cfa-4cab-b52c-416a43746e86 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] Calling method '.version_select at 0x7f0b036aa050>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:02:33 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:33 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-676b1695-5cfa-4cab-b52c-416a43746e86 tempest-ServerActionsTestOtherA-1541374155 tempest-ServerActionsTestOtherA-1541374155-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-695255668" status: 202 len: 0 microversion: 2.1 time: 0.023705 Nov 28 07:02:33 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 352/1068] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 07:02:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-695255668 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:02:37 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:37 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:37 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-ca1962bb-504a-4f5f-b74e-bfb3e3f59512 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "394812ea-6086-45f3-b488-2ebac0e6a0ec"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:02:37 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-ca1962bb-504a-4f5f-b74e-bfb3e3f59512 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:02:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca1962bb-504a-4f5f-b74e-bfb3e3f59512 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca1962bb-504a-4f5f-b74e-bfb3e3f59512 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca1962bb-504a-4f5f-b74e-bfb3e3f59512 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca1962bb-504a-4f5f-b74e-bfb3e3f59512 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca1962bb-504a-4f5f-b74e-bfb3e3f59512 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:37 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ca1962bb-504a-4f5f-b74e-bfb3e3f59512 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:37 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-ca1962bb-504a-4f5f-b74e-bfb3e3f59512 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "POST /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.523985 Nov 28 07:02:37 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 362/1069] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 07:02:37 2023] POST /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/os-volume_attachments => generated 188 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 07:02:37 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b26e8dde-f9e8-4e51-b590-d3f8b1a1c9fd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:02:37 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-b26e8dde-f9e8-4e51-b590-d3f8b1a1c9fd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:02:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b26e8dde-f9e8-4e51-b590-d3f8b1a1c9fd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b26e8dde-f9e8-4e51-b590-d3f8b1a1c9fd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b26e8dde-f9e8-4e51-b590-d3f8b1a1c9fd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b26e8dde-f9e8-4e51-b590-d3f8b1a1c9fd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b26e8dde-f9e8-4e51-b590-d3f8b1a1c9fd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b26e8dde-f9e8-4e51-b590-d3f8b1a1c9fd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-b26e8dde-f9e8-4e51-b590-d3f8b1a1c9fd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/os-volume_attachments/394812ea-6086-45f3-b488-2ebac0e6a0ec" status: 202 len: 0 microversion: 2.20 time: 0.242740 Nov 28 07:02:38 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 356/1070] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 07:02:37 2023] DELETE /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/os-volume_attachments/394812ea-6086-45f3-b488-2ebac0e6a0ec => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:02:38 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:02:38 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:02:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:38 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=64871) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 07:02:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-46807b79-e198-4588-8b96-2e18342c84d9 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "POST /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/action" status: 202 len: 0 microversion: 2.20 time: 0.116547 Nov 28 07:02:38 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 353/1071] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 07:02:38 2023] POST /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:02:38 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:02:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f471c144-40da-4c38-8ed3-7f4958a11fd5 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 200 len: 1660 microversion: 2.20 time: 0.249906 Nov 28 07:02:38 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 363/1072] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 07:02:38 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 1660 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 07:02:40 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:02:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:40 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] Creating event network-changed:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 07:02:40 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e3b9ddb8-df4c-4667-83f6-72835b1ec6bc req-87f89506-ad64-4bc8-8a52-e0561ae1b719 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028488 Nov 28 07:02:40 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 357/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:02:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:02:47 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "name": "network-vif-plugged", "status": "completed", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:02:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] Creating event network-vif-plugged:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 07:02:48 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-37f27a40-f878-455f-8045-cd1a857793bc req-dde31164-58d5-4952-a251-df61f6fe277f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048944 Nov 28 07:02:48 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 354/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:02:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:02:50 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "name": "network-vif-plugged", "status": "completed", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:02:50 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:50 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:02:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:02:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:02:50 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:02:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] Creating event network-vif-plugged:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 07:02:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-2e922ed3-7a04-4b6b-ba67-83fa00857f33 req-3a3adde3-3a15-4141-8385-710b15441a20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048229 Nov 28 07:02:50 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 364/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:02:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:02 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:02 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:03 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-bfaa3206-8c73-45de-a2d1-0a7e72040d8b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:03:03 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-bfaa3206-8c73-45de-a2d1-0a7e72040d8b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bfaa3206-8c73-45de-a2d1-0a7e72040d8b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bfaa3206-8c73-45de-a2d1-0a7e72040d8b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bfaa3206-8c73-45de-a2d1-0a7e72040d8b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bfaa3206-8c73-45de-a2d1-0a7e72040d8b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bfaa3206-8c73-45de-a2d1-0a7e72040d8b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-bfaa3206-8c73-45de-a2d1-0a7e72040d8b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:03 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-bfaa3206-8c73-45de-a2d1-0a7e72040d8b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.317798 Nov 28 07:03:03 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 358/1076] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 07:03:02 2023] GET /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296/os-interface => generated 282 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:04 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:04 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:04 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69564a5-bf33-41a2-bc28-9bf7950be296", "tag": "6e515013-115b-4ad7-9ffb-f4aebd5cca06"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] Creating event network-changed:6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance f69564a5-bf33-41a2-bc28-9bf7950be296 on user Nov 28 07:03:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-2e4f8654-8120-482f-b764-ca58fcbbdfd9 req-3d437b31-06d9-4a78-a9a0-63e68e9b475f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104005 Nov 28 07:03:04 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 355/1077] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:03:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:04 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a17dc5fd-07dd-4698-b421-981621d23318", "device": "/dev/vdb"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:04 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-98b1d9e8-e141-47fe-a01f-2d8e85854102 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293314 Nov 28 07:03:04 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 365/1078] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:03:04 2023] POST /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-2fe5f31f-8e0f-4fdb-b7a2-b95f477cb6aa tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:03:08 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-2fe5f31f-8e0f-4fdb-b7a2-b95f477cb6aa tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2fe5f31f-8e0f-4fdb-b7a2-b95f477cb6aa tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2fe5f31f-8e0f-4fdb-b7a2-b95f477cb6aa tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2fe5f31f-8e0f-4fdb-b7a2-b95f477cb6aa tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2fe5f31f-8e0f-4fdb-b7a2-b95f477cb6aa tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2fe5f31f-8e0f-4fdb-b7a2-b95f477cb6aa tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-2fe5f31f-8e0f-4fdb-b7a2-b95f477cb6aa tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-2fe5f31f-8e0f-4fdb-b7a2-b95f477cb6aa tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.146108 Nov 28 07:03:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 359/1079] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 07:03:08 2023] GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a/os-interface => generated 282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a", "tag": "039674ae-aa8d-4194-a82a-0522d98a3e94"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] Creating event network-changed:039674ae-aa8d-4194-a82a-0522d98a3e94 for instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a on user Nov 28 07:03:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-05f180b0-d6c3-4f84-80bc-4fcfceb022fb req-0e98114f-d595-48c8-a87d-8d5090ebd158 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027979 Nov 28 07:03:09 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 356/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:09 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4e7309fc-a726-49a7-80fa-ae08443f4f83 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:03:09 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4e7309fc-a726-49a7-80fa-ae08443f4f83 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e7309fc-a726-49a7-80fa-ae08443f4f83 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e7309fc-a726-49a7-80fa-ae08443f4f83 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e7309fc-a726-49a7-80fa-ae08443f4f83 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e7309fc-a726-49a7-80fa-ae08443f4f83 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e7309fc-a726-49a7-80fa-ae08443f4f83 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4e7309fc-a726-49a7-80fa-ae08443f4f83 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:09 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-4e7309fc-a726-49a7-80fa-ae08443f4f83 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:03:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4e7309fc-a726-49a7-80fa-ae08443f4f83 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" status: 200 len: 1596 microversion: 2.1 time: 0.201061 Nov 28 07:03:09 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 366/1081] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:03:09 2023] GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a => generated 1596 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:03:09 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:03:09 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:09 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:03:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c7c4aff0-2048-48f3-b388-54955c84e797 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" status: 204 len: 0 microversion: 2.1 time: 0.128994 Nov 28 07:03:09 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 360/1082] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:03:09 2023] DELETE /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e032d1b1-19be-4dd6-9d3b-8350f4328c5d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e032d1b1-19be-4dd6-9d3b-8350f4328c5d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e032d1b1-19be-4dd6-9d3b-8350f4328c5d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e032d1b1-19be-4dd6-9d3b-8350f4328c5d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e032d1b1-19be-4dd6-9d3b-8350f4328c5d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e032d1b1-19be-4dd6-9d3b-8350f4328c5d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e032d1b1-19be-4dd6-9d3b-8350f4328c5d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e032d1b1-19be-4dd6-9d3b-8350f4328c5d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:10 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-e032d1b1-19be-4dd6-9d3b-8350f4328c5d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:03:10 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e032d1b1-19be-4dd6-9d3b-8350f4328c5d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" status: 200 len: 1721 microversion: 2.1 time: 0.451773 Nov 28 07:03:10 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 357/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:03:09 2023] GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a => generated 1721 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:03:10 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a", "name": "network-vif-unplugged", "status": "completed", "tag": "039674ae-aa8d-4194-a82a-0522d98a3e94"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] Creating event network-vif-unplugged:039674ae-aa8d-4194-a82a-0522d98a3e94 for instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a on user Nov 28 07:03:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-8f5dab17-23da-4c2f-a765-8cf3254ffe29 req-7075116f-ee3e-4766-ba7c-9ae625968c17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051392 Nov 28 07:03:10 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 367/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:03:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a", "name": "network-vif-plugged", "status": "completed", "tag": "039674ae-aa8d-4194-a82a-0522d98a3e94"}, {"server_uuid": "62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a", "name": "network-vif-deleted", "tag": "039674ae-aa8d-4194-a82a-0522d98a3e94"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] Creating event network-vif-plugged:039674ae-aa8d-4194-a82a-0522d98a3e94 for instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a on user Nov 28 07:03:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] Creating event network-vif-deleted:039674ae-aa8d-4194-a82a-0522d98a3e94 for instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a on user Nov 28 07:03:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-a401d240-e944-40e7-84f4-2511fa0a0b6f req-0d50da59-794a-4314-97e8-8cf352c3a0d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035310 Nov 28 07:03:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 361/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:03:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=10 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:03:28 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:03:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-4baf46e2-dce8-43e3-bab7-b50de2f34f1b tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 200 len: 1705 microversion: 2.20 time: 0.341832 Nov 28 07:03:28 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 358/1086] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 07:03:28 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 1705 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:30 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lazy-loading 'services' on Instance uuid f69564a5-bf33-41a2-bc28-9bf7950be296 {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:03:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4c326b5c-559f-4203-8980-80f5867e593b tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296/os-volume_attachments/a17dc5fd-07dd-4698-b421-981621d23318" status: 202 len: 0 microversion: 2.1 time: 0.482275 Nov 28 07:03:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 368/1087] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:03:30 2023] DELETE /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296/os-volume_attachments/a17dc5fd-07dd-4698-b421-981621d23318 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:30 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:03:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-8b768e67-1029-41ab-b818-eabaacb292fd tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296" status: 204 len: 0 microversion: 2.1 time: 0.166469 Nov 28 07:03:31 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 362/1088] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:03:30 2023] DELETE /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 28 07:03:31 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ee04dce4-1e65-4d73-bf5a-fcbc316bed5e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:03:31 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ee04dce4-1e65-4d73-bf5a-fcbc316bed5e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ee04dce4-1e65-4d73-bf5a-fcbc316bed5e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ee04dce4-1e65-4d73-bf5a-fcbc316bed5e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ee04dce4-1e65-4d73-bf5a-fcbc316bed5e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ee04dce4-1e65-4d73-bf5a-fcbc316bed5e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ee04dce4-1e65-4d73-bf5a-fcbc316bed5e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ee04dce4-1e65-4d73-bf5a-fcbc316bed5e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:31 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-ee04dce4-1e65-4d73-bf5a-fcbc316bed5e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37eb76cab93f4dfd97bf85828d89df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82be9b17ed614b8aa2bb7172eedf516e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:03:31 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ee04dce4-1e65-4d73-bf5a-fcbc316bed5e tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296" status: 200 len: 1711 microversion: 2.1 time: 0.283021 Nov 28 07:03:31 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 359/1089] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:03:31 2023] GET /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296 => generated 1711 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 07:03:37 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-21720650-e87e-41c0-9249-da395aa0e607 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Action: 'create', calling method: .version_select at 0x7f0b035f1ab0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1887206196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/8TK0s6S6jr6eVoVISilIkFNISMDUr3k40yMWuPUApm+U40gTGbmzKNum2DQ1fk//z2lD/tCVOMz+xgbRbztjSm+nTNW4EUfhK5oA+KcwC8c2v28/4DXqA2z9nZAmGbw=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:38 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-21720650-e87e-41c0-9249-da395aa0e607 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Getting quotas for project 8f9fb47f7da246f9b569ca12206c5726. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:03:38 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-21720650-e87e-41c0-9249-da395aa0e607 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Getting quotas for user a54dae1189f7405eb8b8b1aefe0b6ce7 and project 8f9fb47f7da246f9b569ca12206c5726. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:03:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-21720650-e87e-41c0-9249-da395aa0e607 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.270165 Nov 28 07:03:38 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 369/1090] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 07:03:37 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:44 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-945636414", "imageRef": "", "flavorRef": "1", "key_name": "tempest-TestShelveInstance-1887206196", "security_groups": [{"name": "tempest-secgroup-smoke-1332634271"}], "networks": [{"uuid": "fa2c7e3c-130c-4424-a022-179dd0bd6f04"}], "block_device_mapping_v2": [{"uuid": "b5ec27cc-cec3-483f-8d88-6568e398a02e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:44 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:44 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:44 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] validate_networks() for [('fa2c7e3c-130c-4424-a022-179dd0bd6f04', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Getting quotas for project 8f9fb47f7da246f9b569ca12206c5726. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Getting quotas for user a54dae1189f7405eb8b8b1aefe0b6ce7 and project 8f9fb47f7da246f9b569ca12206c5726. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 07:03:45 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5ec27cc-cec3-483f-8d88-6568e398a02e',volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 07:03:45 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9ee1e43d-11d3-4e7f-9bbb-0b22f79e738b tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.002575 Nov 28 07:03:45 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 363/1091] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 07:03:44 2023] POST /compute/v2.1/servers => generated 404 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 07:03:45 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-cc008176-3fca-464a-a191-b788f463a0ef tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:03:45 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-cc008176-3fca-464a-a191-b788f463a0ef tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:03:45 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:45 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=12 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:45 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-cc008176-3fca-464a-a191-b788f463a0ef tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a54dae1189f7405eb8b8b1aefe0b6ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9fb47f7da246f9b569ca12206c5726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:03:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-cc008176-3fca-464a-a191-b788f463a0ef tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe" status: 200 len: 1081 microversion: 2.1 time: 0.068210 Nov 28 07:03:45 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 360/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:03:45 2023] GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe => generated 1081 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:03:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:47 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] Creating event network-changed:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:03:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-881ae694-7145-4585-837f-8d3f04c5897c req-3cc32581-4a55-4c73-9864-742b8c5eeebf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035271 Nov 28 07:03:47 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 370/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:03:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:52 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69564a5-bf33-41a2-bc28-9bf7950be296", "name": "network-vif-unplugged", "status": "completed", "tag": "6e515013-115b-4ad7-9ffb-f4aebd5cca06"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:52 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] Creating event network-vif-unplugged:6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance f69564a5-bf33-41a2-bc28-9bf7950be296 on user Nov 28 07:03:52 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-1e9dc68c-a41a-47ff-bb91-859b99bd207e req-05d88de3-eb48-47c7-9616-e3f6f507c19f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032125 Nov 28 07:03:52 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 364/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:03:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69564a5-bf33-41a2-bc28-9bf7950be296", "name": "network-vif-plugged", "status": "completed", "tag": "6e515013-115b-4ad7-9ffb-f4aebd5cca06"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:55 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] Creating event network-vif-plugged:6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance f69564a5-bf33-41a2-bc28-9bf7950be296 on user Nov 28 07:03:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-d4121ea4-ef9f-4a40-9cdb-d58ac2d77092 req-ef91ead2-6012-4e6f-8644-391b5c5c3d93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028542 Nov 28 07:03:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 361/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:03:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:56 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:56 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-f9ac40b5-8e28-4b1a-af43-075e28817d8d req-9d5c4dbb-c255-4ed6-ac07-1044b6791366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69564a5-bf33-41a2-bc28-9bf7950be296", "name": "network-vif-deleted", "tag": "6e515013-115b-4ad7-9ffb-f4aebd5cca06"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f9ac40b5-8e28-4b1a-af43-075e28817d8d req-9d5c4dbb-c255-4ed6-ac07-1044b6791366 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f9ac40b5-8e28-4b1a-af43-075e28817d8d req-9d5c4dbb-c255-4ed6-ac07-1044b6791366 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-f9ac40b5-8e28-4b1a-af43-075e28817d8d req-9d5c4dbb-c255-4ed6-ac07-1044b6791366 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-f9ac40b5-8e28-4b1a-af43-075e28817d8d req-9d5c4dbb-c255-4ed6-ac07-1044b6791366 service nova] Creating event network-vif-deleted:6e515013-115b-4ad7-9ffb-f4aebd5cca06 for instance f69564a5-bf33-41a2-bc28-9bf7950be296 on user Nov 28 07:03:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-f9ac40b5-8e28-4b1a-af43-075e28817d8d req-9d5c4dbb-c255-4ed6-ac07-1044b6791366 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101189 Nov 28 07:03:56 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 371/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:03:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:56 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:56 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:56 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "name": "network-vif-plugged", "status": "completed", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] Creating event network-vif-plugged:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:03:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-f26ad649-6595-4300-9dfb-a8418fc92523 req-540192f2-2e2b-4b94-b17c-1dde8f22418b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058352 Nov 28 07:03:56 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 365/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:03:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:03:58 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:03:58 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "name": "network-vif-plugged", "status": "completed", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:03:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:03:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:03:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:03:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] Creating event network-vif-plugged:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:03:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-148c0e3d-d18a-455d-b8c8-bf0240514d7c req-00139bfe-3a1c-4bb6-b929-b236ed6a501a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031148 Nov 28 07:03:58 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 362/1098] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:03:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:04:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:00 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a could not be found. Nov 28 07:04:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:04:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-03f68486-1dbf-42e0-be68-597e06d5b659 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" status: 404 len: 111 microversion: 2.1 time: 0.030433 Nov 28 07:04:00 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 372/1099] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:04:00 2023] GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:04:03 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:03 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:03 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:04:03 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-8c72f612-4972-4e74-abaa-08b74b5d94e6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f" status: 204 len: 0 microversion: 2.1 time: 0.108571 Nov 28 07:04:03 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 366/1100] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:04:03 2023] DELETE /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:04:03 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8d97596b-7e98-408f-8117-aebfaf07bc09 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:03 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8d97596b-7e98-408f-8117-aebfaf07bc09 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8d97596b-7e98-408f-8117-aebfaf07bc09 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8d97596b-7e98-408f-8117-aebfaf07bc09 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8d97596b-7e98-408f-8117-aebfaf07bc09 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8d97596b-7e98-408f-8117-aebfaf07bc09 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8d97596b-7e98-408f-8117-aebfaf07bc09 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:03 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8d97596b-7e98-408f-8117-aebfaf07bc09 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:04 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-8d97596b-7e98-408f-8117-aebfaf07bc09 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:04:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304574e5-b806-44dc-9302-cdce2822898f", "name": "network-vif-unplugged", "status": "completed", "tag": "3eb0757a-68b5-4718-b270-812c217e9e86"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:04:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8d97596b-7e98-408f-8117-aebfaf07bc09 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f" status: 200 len: 1563 microversion: 2.1 time: 0.311438 Nov 28 07:04:04 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 363/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:04:03 2023] GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f => generated 1563 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:04:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] Creating event network-vif-unplugged:3eb0757a-68b5-4718-b270-812c217e9e86 for instance 304574e5-b806-44dc-9302-cdce2822898f on user Nov 28 07:04:04 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-9ba7f67c-a70c-4948-ada4-88947d0eccc1 req-7f6a2c76-5a0d-46a8-b36d-ff7a21e6706a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031518 Nov 28 07:04:04 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 373/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:04:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:04:06 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304574e5-b806-44dc-9302-cdce2822898f", "name": "network-vif-plugged", "status": "completed", "tag": "3eb0757a-68b5-4718-b270-812c217e9e86"}, {"server_uuid": "304574e5-b806-44dc-9302-cdce2822898f", "name": "network-vif-deleted", "tag": "3eb0757a-68b5-4718-b270-812c217e9e86"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:04:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:06 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] Creating event network-vif-plugged:3eb0757a-68b5-4718-b270-812c217e9e86 for instance 304574e5-b806-44dc-9302-cdce2822898f on user Nov 28 07:04:06 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] Creating event network-vif-deleted:3eb0757a-68b5-4718-b270-812c217e9e86 for instance 304574e5-b806-44dc-9302-cdce2822898f on user Nov 28 07:04:06 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-36e40e9c-6a45-40b6-bf5a-32fa3cc14e4f req-41f818c5-ce1d-4480-9bed-58b295bad3ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032034 Nov 28 07:04:06 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 367/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:04:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] [instance: f69564a5-bf33-41a2-bc28-9bf7950be296] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=10 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=10 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] HTTP exception thrown: Instance f69564a5-bf33-41a2-bc28-9bf7950be296 could not be found. Nov 28 07:04:21 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Returning 404 to user: Instance f69564a5-bf33-41a2-bc28-9bf7950be296 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:04:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-97c27598-1e81-45be-960b-d7dec2eb37ac tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296" status: 404 len: 111 microversion: 2.1 time: 0.030449 Nov 28 07:04:21 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 364/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:04:21 2023] GET /compute/v2.1/servers/f69564a5-bf33-41a2-bc28-9bf7950be296 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:04:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=8 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:21 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-09140790-e551-4166-8e8f-877ae7338381 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] Calling method '.version_select at 0x7f0b03457be0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-09140790-e551-4166-8e8f-877ae7338381 tempest-VolumesSnapshotTestJSON-719548845 tempest-VolumesSnapshotTestJSON-719548845-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-74843823" status: 202 len: 0 microversion: 2.1 time: 0.028370 Nov 28 07:04:21 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 374/1105] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Nov 28 07:04:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-74843823 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-29a98b6d-41c5-4e84-944e-b44715776835 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-29a98b6d-41c5-4e84-944e-b44715776835 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-29a98b6d-41c5-4e84-944e-b44715776835 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-29a98b6d-41c5-4e84-944e-b44715776835 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-29a98b6d-41c5-4e84-944e-b44715776835 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-29a98b6d-41c5-4e84-944e-b44715776835 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-29a98b6d-41c5-4e84-944e-b44715776835 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-29a98b6d-41c5-4e84-944e-b44715776835 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-29a98b6d-41c5-4e84-944e-b44715776835 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059494 Nov 28 07:04:29 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 368/1106] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 07:04:29 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:04:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:29 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:29 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:04:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-7bffb527-bd51-46d1-9d7c-0c807b8778dd tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 204 len: 0 microversion: 2.20 time: 0.230157 Nov 28 07:04:29 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 365/1107] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 07:04:29 2023] DELETE /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "name": "network-vif-unplugged", "status": "completed", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:04:29 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbf659ad4b8f43a2bc497d01be58d846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d769a1c976c468f804770d89c92ae94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:04:29 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-3bda996d-c02e-482c-909f-f7b5694eb4ed tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 200 len: 1711 microversion: 2.20 time: 0.301552 Nov 28 07:04:29 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 375/1108] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 07:04:29 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 1711 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:29 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] Creating event network-vif-unplugged:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 07:04:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-6db4ccfd-89cd-4ea0-9081-06f90fec6446 req-61d99465-7f10-49a4-9911-e5df32cbbca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053800 Nov 28 07:04:29 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 369/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:04:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:04:31 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-0fad63c6-5560-441a-9165-612c5e490d5d req-f540291e-e4a7-45b3-a148-6aafa3fca5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "name": "network-vif-deleted", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:04:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0fad63c6-5560-441a-9165-612c5e490d5d req-f540291e-e4a7-45b3-a148-6aafa3fca5f9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0fad63c6-5560-441a-9165-612c5e490d5d req-f540291e-e4a7-45b3-a148-6aafa3fca5f9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0fad63c6-5560-441a-9165-612c5e490d5d req-f540291e-e4a7-45b3-a148-6aafa3fca5f9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:31 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-0fad63c6-5560-441a-9165-612c5e490d5d req-f540291e-e4a7-45b3-a148-6aafa3fca5f9 service nova] Creating event network-vif-deleted:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 07:04:31 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-0fad63c6-5560-441a-9165-612c5e490d5d req-f540291e-e4a7-45b3-a148-6aafa3fca5f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044061 Nov 28 07:04:31 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 366/1110] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:04:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:04:31 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d4327e-1732-4e71-be0d-05ae08e312b5", "name": "network-vif-plugged", "status": "completed", "tag": "b8282f0c-783f-4279-b530-d188e9b43e49"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:04:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:31 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] Creating event network-vif-plugged:b8282f0c-783f-4279-b530-d188e9b43e49 for instance 57d4327e-1732-4e71-be0d-05ae08e312b5 on user Nov 28 07:04:31 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-c1e19dd5-1ffa-488f-8b32-b5b54795e616 req-9eac9249-1b4f-444c-a5ef-de9fa20ff804 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029630 Nov 28 07:04:31 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 376/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:04:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:04:35 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5964ccc9-69fc-427d-8b7b-f5f72b8039ad tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:35 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5964ccc9-69fc-427d-8b7b-f5f72b8039ad tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5964ccc9-69fc-427d-8b7b-f5f72b8039ad tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5964ccc9-69fc-427d-8b7b-f5f72b8039ad tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5964ccc9-69fc-427d-8b7b-f5f72b8039ad tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5964ccc9-69fc-427d-8b7b-f5f72b8039ad tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5964ccc9-69fc-427d-8b7b-f5f72b8039ad tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5964ccc9-69fc-427d-8b7b-f5f72b8039ad tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:35 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-5964ccc9-69fc-427d-8b7b-f5f72b8039ad tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a54dae1189f7405eb8b8b1aefe0b6ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9fb47f7da246f9b569ca12206c5726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:04:35 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5964ccc9-69fc-427d-8b7b-f5f72b8039ad tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe" status: 200 len: 1431 microversion: 2.1 time: 0.241772 Nov 28 07:04:35 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 370/1112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:04:35 2023] GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe => generated 1431 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance 304574e5-b806-44dc-9302-cdce2822898f could not be found. Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance 304574e5-b806-44dc-9302-cdce2822898f could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:04:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-19fb6fcc-5f6c-4533-b26e-a578d2fd0e4b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f" status: 404 len: 111 microversion: 2.1 time: 0.037801 Nov 28 07:04:54 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 367/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:04:54 2023] GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=8 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:54 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a could not be found. Nov 28 07:04:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:04:54 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-2f8f4a3b-62b9-43bb-8b1b-c915f01addb2 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" status: 404 len: 111 microversion: 2.1 time: 0.042337 Nov 28 07:04:54 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 377/1114] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:04:54 2023] DELETE /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=14 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:54 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a could not be found. Nov 28 07:04:54 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance 62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:04:54 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-ec89e5d6-a680-4354-a75e-20a8e391bbb7 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a" status: 404 len: 111 microversion: 2.1 time: 0.032201 Nov 28 07:04:54 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 371/1115] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:04:54 2023] GET /compute/v2.1/servers/62e0a6c0-b13e-4892-99dd-0b8c6cbdba1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:04:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8a7df785-d551-4264-9f2b-39e65a8b64ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '.version_select at 0x7f0b03565d80>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8a7df785-d551-4264-9f2b-39e65a8b64ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966967716" status: 202 len: 0 microversion: 2.1 time: 0.025759 Nov 28 07:04:54 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 368/1116] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 07:04:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966967716 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:04:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:55 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance 304574e5-b806-44dc-9302-cdce2822898f could not be found. Nov 28 07:04:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance 304574e5-b806-44dc-9302-cdce2822898f could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:04:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-c8dea2a4-86c1-44b7-ba71-f96c202f2709 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f" status: 404 len: 111 microversion: 2.1 time: 0.026575 Nov 28 07:04:55 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 378/1117] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:04:55 2023] DELETE /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:04:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:55 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 304574e5-b806-44dc-9302-cdce2822898f] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:04:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:04:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:04:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:04:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance 304574e5-b806-44dc-9302-cdce2822898f could not be found. Nov 28 07:04:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance 304574e5-b806-44dc-9302-cdce2822898f could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:04:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-3fb129fb-71c4-414e-b3b6-50e8436e4c04 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f" status: 404 len: 111 microversion: 2.1 time: 0.028481 Nov 28 07:04:55 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 372/1118] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:04:55 2023] GET /compute/v2.1/servers/304574e5-b806-44dc-9302-cdce2822898f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:04:55 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5f1004da-36c0-49de-9c06-00003eae4cb1 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '.version_select at 0x7f0b03505630>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:04:55 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5f1004da-36c0-49de-9c06-00003eae4cb1 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-6317093" status: 202 len: 0 microversion: 2.1 time: 0.024440 Nov 28 07:04:55 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 369/1119] 10.0.0.210 () {62 vars in 1289 bytes} [Tue Nov 28 07:04:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-6317093 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:04:56 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b32940b7-e6a2-45fe-8133-cf632bad5efb tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Action: 'create', calling method: .version_select at 0x7f0b0351b400>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1183583656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcxzsnQ041tX8GtegPWCG8gdIOivTAVCkoG0n+tEezRsODn5fgnH6OW/xDq/VuBX7zAmc7MijcySF1m9whuuYuxn7AxigaK4vtqJVrF4jmczdNBIOy5gxlw9QID09N+bQ=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:04:56 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-b32940b7-e6a2-45fe-8133-cf632bad5efb tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:04:56 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-b32940b7-e6a2-45fe-8133-cf632bad5efb tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for user 2139976b453e4bd2b8e83e551a0cc772 and project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:04:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b32940b7-e6a2-45fe-8133-cf632bad5efb tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.045470 Nov 28 07:04:56 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 379/1120] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 07:04:56 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:05:02 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-897983027", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-83750153"}], "block_device_mapping_v2": [{"uuid": "fba423b6-1127-46d5-a9a7-87dd41849861", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-1183583656", "networks": [{"uuid": "7d507ecb-7146-47b0-98b6-2939026c2b05"}]}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:05:02 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] validate_networks() for [('7d507ecb-7146-47b0-98b6-2939026c2b05', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for user 2139976b453e4bd2b8e83e551a0cc772 and project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 07:05:03 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fba423b6-1127-46d5-a9a7-87dd41849861',volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 07:05:03 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6f545398-cd91-41e8-8e2d-3af38a9639ab tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.020840 Nov 28 07:05:03 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 373/1121] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 07:05:02 2023] POST /compute/v2.1/servers => generated 402 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 07:05:03 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-60e2f3a3-5c50-4404-8051-4ce486810030 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:05:03 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-60e2f3a3-5c50-4404-8051-4ce486810030 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:05:03 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-60e2f3a3-5c50-4404-8051-4ce486810030 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:05:03 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-60e2f3a3-5c50-4404-8051-4ce486810030 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097" status: 200 len: 1087 microversion: 2.1 time: 0.091348 Nov 28 07:05:03 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 370/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:05:03 2023] GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097 => generated 1087 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:05:06 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:06 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:06 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:05:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:06 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] Creating event network-changed:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:05:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-14ecc7c0-ca5b-4c15-87a2-5d98c5cff436 req-204dfa3a-f1a4-407f-9763-becc2a1daad1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034854 Nov 28 07:05:06 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 380/1123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:05:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:05:14 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:14 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:14 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:14 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:14 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "name": "network-vif-plugged", "status": "completed", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:05:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:14 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] Creating event network-vif-plugged:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:05:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-edcce42c-589c-4c90-8fe7-f4ad8c17df69 req-889f00f7-8fa5-4a0e-b961-2cc22d4e805d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057877 Nov 28 07:05:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 374/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:05:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:05:16 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "name": "network-vif-plugged", "status": "completed", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:05:16 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:16 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:16 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] Creating event network-vif-plugged:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:05:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-a4456b71-edb7-4dd8-8704-4735bb520056 req-58a6772e-f2fe-4af4-a26e-19de181f7132 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038320 Nov 28 07:05:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 371/1125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:05:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:05:19 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:19 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:20 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:05:20 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:05:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] HTTP exception thrown: Instance 57d4327e-1732-4e71-be0d-05ae08e312b5 could not be found. Nov 28 07:05:20 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Returning 404 to user: Instance 57d4327e-1732-4e71-be0d-05ae08e312b5 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:05:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a54f8d01-c2c9-4e72-a63b-e08db679efa2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 404 len: 111 microversion: 2.20 time: 0.064280 Nov 28 07:05:20 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 381/1126] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 07:05:19 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 07:05:20 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-42e66112-a11c-431f-af6f-45de09940f24 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '.version_select at 0x7f0b03724c10>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:05:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-42e66112-a11c-431f-af6f-45de09940f24 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691834733" status: 204 len: 0 microversion: 2.20 time: 0.022725 Nov 28 07:05:20 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 375/1127] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 07:05:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691834733 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 07:05:24 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:05:24 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:05:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:24 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] HTTP exception thrown: Instance 57d4327e-1732-4e71-be0d-05ae08e312b5 could not be found. Nov 28 07:05:24 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Returning 404 to user: Instance 57d4327e-1732-4e71-be0d-05ae08e312b5 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:05:24 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f483a0d8-f0bf-4f21-9d94-a3aad9143728 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 404 len: 111 microversion: 2.20 time: 0.028197 Nov 28 07:05:24 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 372/1128] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 07:05:24 2023] DELETE /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 07:05:24 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:05:24 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 57d4327e-1732-4e71-be0d-05ae08e312b5] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:05:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:24 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] HTTP exception thrown: Instance 57d4327e-1732-4e71-be0d-05ae08e312b5 could not be found. Nov 28 07:05:24 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Returning 404 to user: Instance 57d4327e-1732-4e71-be0d-05ae08e312b5 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:05:24 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-893cb34a-e372-4f4b-aedd-0932a9eb32a7 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5" status: 404 len: 111 microversion: 2.20 time: 0.027349 Nov 28 07:05:24 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 382/1129] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 07:05:24 2023] GET /compute/v2.1/servers/57d4327e-1732-4e71-be0d-05ae08e312b5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 07:05:27 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:27 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:05:27 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:05:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:27 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] HTTP exception thrown: Instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad could not be found. Nov 28 07:05:27 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Returning 404 to user: Instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:05:27 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c177f460-243d-4d73-befa-aae73938e6d2 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 404 len: 111 microversion: 2.20 time: 0.030720 Nov 28 07:05:27 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 376/1130] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 07:05:27 2023] DELETE /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 07:05:27 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:05:27 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] [instance: 4fe14a8c-afa2-43b4-a885-914f4c8195ad] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:05:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:27 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] HTTP exception thrown: Instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad could not be found. Nov 28 07:05:27 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] Returning 404 to user: Instance 4fe14a8c-afa2-43b4-a885-914f4c8195ad could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:05:27 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-8307e4fd-9b20-4050-90ff-c50ab1b7b1c6 tempest-AttachVolumeShelveTestJSON-92318211 tempest-AttachVolumeShelveTestJSON-92318211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad" status: 404 len: 111 microversion: 2.20 time: 0.030942 Nov 28 07:05:27 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 373/1131] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 07:05:27 2023] GET /compute/v2.1/servers/4fe14a8c-afa2-43b4-a885-914f4c8195ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 07:05:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9f1da77c-8943-4422-8b24-a0fd94db51e1 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:05:35 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-9f1da77c-8943-4422-8b24-a0fd94db51e1 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:05:35 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:35 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9f1da77c-8943-4422-8b24-a0fd94db51e1 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9f1da77c-8943-4422-8b24-a0fd94db51e1 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9f1da77c-8943-4422-8b24-a0fd94db51e1 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9f1da77c-8943-4422-8b24-a0fd94db51e1 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9f1da77c-8943-4422-8b24-a0fd94db51e1 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:35 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9f1da77c-8943-4422-8b24-a0fd94db51e1 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:36 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-9f1da77c-8943-4422-8b24-a0fd94db51e1 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a54dae1189f7405eb8b8b1aefe0b6ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9fb47f7da246f9b569ca12206c5726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:05:36 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-9f1da77c-8943-4422-8b24-a0fd94db51e1 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe" status: 200 len: 1431 microversion: 2.1 time: 0.256080 Nov 28 07:05:36 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 383/1132] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:05:35 2023] GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe => generated 1431 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:05:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:05:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] Creating event network-changed:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:05:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-90afd5ec-7a54-4d01-9848-6a08e8f0c903 req-e4f7cc23-e77a-46e1-a78e-7a31274f7a6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053200 Nov 28 07:05:38 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 377/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:05:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:38 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lazy-loading 'flavor' on Instance uuid 6a69c84f-a030-4262-8f84-7d4bd72db3fe {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:05:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-297d17ab-46fc-4b9d-93b6-f029652246d8 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.122375 Nov 28 07:05:38 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 374/1134] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 07:05:38 2023] POST /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:05:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9e32f527-5f0f-41f9-a6aa-89dc7ad337d4 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:05:38 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-9e32f527-5f0f-41f9-a6aa-89dc7ad337d4 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:05:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9e32f527-5f0f-41f9-a6aa-89dc7ad337d4 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9e32f527-5f0f-41f9-a6aa-89dc7ad337d4 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9e32f527-5f0f-41f9-a6aa-89dc7ad337d4 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9e32f527-5f0f-41f9-a6aa-89dc7ad337d4 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9e32f527-5f0f-41f9-a6aa-89dc7ad337d4 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9e32f527-5f0f-41f9-a6aa-89dc7ad337d4 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:39 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-9e32f527-5f0f-41f9-a6aa-89dc7ad337d4 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a54dae1189f7405eb8b8b1aefe0b6ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9fb47f7da246f9b569ca12206c5726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:05:39 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-9e32f527-5f0f-41f9-a6aa-89dc7ad337d4 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe" status: 200 len: 1555 microversion: 2.1 time: 0.352299 Nov 28 07:05:39 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 384/1135] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:05:38 2023] GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe => generated 1555 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:05:39 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "name": "network-vif-unplugged", "status": "completed", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:05:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] Creating event network-vif-unplugged:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:05:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-a5466877-78ab-4dfe-9320-c060992dd22b req-99dd8be7-05b8-4086-9a3f-4e860e36399f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040328 Nov 28 07:05:39 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 378/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:05:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:05:40 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:05:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:40 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] Creating event network-changed:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:05:40 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-43ecc0d4-e297-49bf-9e26-5d7d02db6036 req-ec015faa-5239-48e6-b326-edaa3f216c1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031078 Nov 28 07:05:40 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 375/1137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:05:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:05:41 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "name": "network-vif-plugged", "status": "completed", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:05:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:41 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] Creating event network-vif-plugged:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:05:41 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-0a667875-b5b8-46e0-82af-2627dadeadd2 req-a75cd3af-e40f-45dd-bf00-f061a0dc2b13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032785 Nov 28 07:05:41 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 385/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:05:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:05:53 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:53 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:05:53 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-acdf4a45-70f0-4440-a506-c0665fffa573 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:05:53 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-acdf4a45-70f0-4440-a506-c0665fffa573 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:05:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-acdf4a45-70f0-4440-a506-c0665fffa573 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-acdf4a45-70f0-4440-a506-c0665fffa573 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-acdf4a45-70f0-4440-a506-c0665fffa573 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-acdf4a45-70f0-4440-a506-c0665fffa573 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:05:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-acdf4a45-70f0-4440-a506-c0665fffa573 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:05:53 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-acdf4a45-70f0-4440-a506-c0665fffa573 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:05:54 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-acdf4a45-70f0-4440-a506-c0665fffa573 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:05:54 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-acdf4a45-70f0-4440-a506-c0665fffa573 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097" status: 200 len: 1439 microversion: 2.1 time: 0.230736 Nov 28 07:05:54 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 379/1139] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:05:53 2023] GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097 => generated 1439 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:06:12 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:12 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:12 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-06deda8f-e993-4ab9-a941-b63937681c0d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'create', calling method: .version_select at 0x7f0b03505b40>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1018447659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGmpsVi3rnJBLhjJZcSrxqoEovxWluIXhWXRkNfqFtPbjohGX3cyMlNWyskK4OB7fv/dsOPWmp9Gakmlq0rEbulZ/JfWNfszNiM91xPmtUOEGlIaLYG01yTzLtc5cSwQA=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:06:12 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-06deda8f-e993-4ab9-a941-b63937681c0d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting quotas for project 3af4e4870f934158819e183bbc7b499e. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:06:12 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-06deda8f-e993-4ab9-a941-b63937681c0d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting quotas for user 41da15820f7d43dfad1503c8d7355e6c and project 3af4e4870f934158819e183bbc7b499e. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:06:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-06deda8f-e993-4ab9-a941-b63937681c0d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.238407 Nov 28 07:06:13 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 376/1140] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 07:06:12 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=14 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-51240574", "imageRef": "d3a1e6c9-018f-495e-8204-f598e626c948", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-1018447659", "networks": [{"uuid": "dd15a0ea-6ca0-4839-b3c1-2e1006503361"}]}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.network.neutron [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] validate_networks() for [('dd15a0ea-6ca0-4839-b3c1-2e1006503361', None, None, None, None, None)] {{(pid=64872) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flavor limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Image limits 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flavor pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Image pref 0:0:0 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.virt.hardware [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting quotas for project 3af4e4870f934158819e183bbc7b499e. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting quotas for user 41da15820f7d43dfad1503c8d7355e6c and project 3af4e4870f934158819e183bbc7b499e. Resources: {'instances', 'cores', 'ram'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Going to run 1 instances... {{(pid=64872) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 07:06:13 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3a1e6c9-018f-495e-8204-f598e626c948',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 07:06:13 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-01cf8e5e-1a56-49c5-a56d-2a177bec0eed tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.779565 Nov 28 07:06:13 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 386/1141] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 07:06:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 07:06:13 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-2983cb88-aaa7-457f-8e11-1a6ac7a3f015 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:06:13 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-2983cb88-aaa7-457f-8e11-1a6ac7a3f015 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:06:13 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:13 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:14 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-2983cb88-aaa7-457f-8e11-1a6ac7a3f015 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:06:14 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-2983cb88-aaa7-457f-8e11-1a6ac7a3f015 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 200 len: 1249 microversion: 2.1 time: 0.185931 Nov 28 07:06:14 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 380/1142] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:06:13 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 1249 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:06:16 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:06:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:16 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] Creating event network-changed:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:06:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-0d1b7c01-d0b7-4758-8b53-d95dd5baf3b7 req-7b756643-d767-4399-96cd-ab4daaae3c8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031015 Nov 28 07:06:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 377/1143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:06:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:06:18 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-plugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:06:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] Creating event network-vif-plugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:06:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-1cb8a786-f32d-42ae-a974-dc050380807b req-8684bc0d-e4f9-4704-a74b-e9ccd929984c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049451 Nov 28 07:06:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 387/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:06:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:06:20 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-plugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:06:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] Creating event network-vif-plugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:06:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-5e239c91-60c7-4141-bd85-835604e713db req-f2a186aa-008d-4b3c-94e5-1e33165fdfd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030170 Nov 28 07:06:20 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 381/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:06:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-164748f3-c0bf-4eba-9236-372b1aefd577 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-164748f3-c0bf-4eba-9236-372b1aefd577 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-164748f3-c0bf-4eba-9236-372b1aefd577 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-164748f3-c0bf-4eba-9236-372b1aefd577 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-164748f3-c0bf-4eba-9236-372b1aefd577 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-164748f3-c0bf-4eba-9236-372b1aefd577 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-164748f3-c0bf-4eba-9236-372b1aefd577 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-164748f3-c0bf-4eba-9236-372b1aefd577 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:29 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-164748f3-c0bf-4eba-9236-372b1aefd577 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a54dae1189f7405eb8b8b1aefe0b6ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9fb47f7da246f9b569ca12206c5726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:06:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-164748f3-c0bf-4eba-9236-372b1aefd577 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe" status: 200 len: 1496 microversion: 2.1 time: 0.286833 Nov 28 07:06:29 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 378/1146] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:06:29 2023] GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe => generated 1496 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-14216781-d9a5-4612-abc2-80e0a024fec6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-14216781-d9a5-4612-abc2-80e0a024fec6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-14216781-d9a5-4612-abc2-80e0a024fec6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-14216781-d9a5-4612-abc2-80e0a024fec6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-14216781-d9a5-4612-abc2-80e0a024fec6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-14216781-d9a5-4612-abc2-80e0a024fec6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-14216781-d9a5-4612-abc2-80e0a024fec6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-14216781-d9a5-4612-abc2-80e0a024fec6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:54 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-14216781-d9a5-4612-abc2-80e0a024fec6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:06:54 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-14216781-d9a5-4612-abc2-80e0a024fec6 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097" status: 200 len: 1439 microversion: 2.1 time: 0.381889 Nov 28 07:06:54 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 388/1147] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:06:54 2023] GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097 => generated 1439 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:06:55 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:55 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:55 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:06:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] Creating event network-changed:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:06:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-41772f6d-ba43-42be-b022-1fcfe77b8bcc req-f3ba199b-03d9-4d8a-9bbb-302f77e568b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038161 Nov 28 07:06:55 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 382/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:06:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:56 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:06:56 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-4204face-946b-44c6-9c75-2d01a0188b0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097" status: 204 len: 0 microversion: 2.1 time: 0.124622 Nov 28 07:06:56 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 379/1149] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:06:56 2023] DELETE /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:06:56 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-79ab15ea-afdd-4938-ba89-f818e744cf7d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:06:56 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-79ab15ea-afdd-4938-ba89-f818e744cf7d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:06:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79ab15ea-afdd-4938-ba89-f818e744cf7d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79ab15ea-afdd-4938-ba89-f818e744cf7d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79ab15ea-afdd-4938-ba89-f818e744cf7d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79ab15ea-afdd-4938-ba89-f818e744cf7d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79ab15ea-afdd-4938-ba89-f818e744cf7d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:56 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-79ab15ea-afdd-4938-ba89-f818e744cf7d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:56 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-79ab15ea-afdd-4938-ba89-f818e744cf7d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:06:56 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-79ab15ea-afdd-4938-ba89-f818e744cf7d tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097" status: 200 len: 1563 microversion: 2.1 time: 0.167357 Nov 28 07:06:56 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 389/1150] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:06:56 2023] GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:06:56 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "name": "network-vif-unplugged", "status": "completed", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:06:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:56 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] Creating event network-vif-unplugged:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:06:56 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-eca0ea3e-3a26-4ac2-be49-7bd41b242975 req-78c3a069-cb26-44e7-85bf-392cfadec97c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029207 Nov 28 07:06:56 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 383/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:06:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:06:58 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "name": "network-vif-plugged", "status": "completed", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}, {"server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "name": "network-vif-plugged", "status": "completed", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}, {"server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "name": "network-vif-plugged", "status": "completed", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}, {"server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "name": "network-vif-unplugged", "status": "completed", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}, {"server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "name": "network-vif-plugged", "status": "completed", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:06:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:06:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:06:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:06:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Creating event network-vif-plugged:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:06:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Creating event network-vif-plugged:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:06:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Creating event network-vif-plugged:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:06:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Creating event network-vif-unplugged:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:06:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] Creating event network-vif-plugged:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:06:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-b817a78e-1ff0-461c-8f7c-6263d3721e8f req-28780a58-cd3b-4cd2-a96f-834c4b282fcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031975 Nov 28 07:06:58 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 380/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:06:58 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:07:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-ae9ae58b-fba3-4457-aefb-b13410909f5b req-05717717-035f-4fef-a42c-2d1750f90917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f112048f-4224-409f-bb75-63eb252c6097", "name": "network-vif-deleted", "tag": "1b92c19d-d039-4173-97fc-8d84aed4a840"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:07:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ae9ae58b-fba3-4457-aefb-b13410909f5b req-05717717-035f-4fef-a42c-2d1750f90917 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ae9ae58b-fba3-4457-aefb-b13410909f5b req-05717717-035f-4fef-a42c-2d1750f90917 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ae9ae58b-fba3-4457-aefb-b13410909f5b req-05717717-035f-4fef-a42c-2d1750f90917 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ae9ae58b-fba3-4457-aefb-b13410909f5b req-05717717-035f-4fef-a42c-2d1750f90917 service nova] Creating event network-vif-deleted:1b92c19d-d039-4173-97fc-8d84aed4a840 for instance f112048f-4224-409f-bb75-63eb252c6097 on user Nov 28 07:07:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-ae9ae58b-fba3-4457-aefb-b13410909f5b req-05717717-035f-4fef-a42c-2d1750f90917 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031721 Nov 28 07:07:00 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 390/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:07:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:07:04 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5eb37f69-48c5-4bb0-b1ea-b338ff3c1032 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:07:04 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5eb37f69-48c5-4bb0-b1ea-b338ff3c1032 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:07:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5eb37f69-48c5-4bb0-b1ea-b338ff3c1032 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5eb37f69-48c5-4bb0-b1ea-b338ff3c1032 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5eb37f69-48c5-4bb0-b1ea-b338ff3c1032 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5eb37f69-48c5-4bb0-b1ea-b338ff3c1032 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5eb37f69-48c5-4bb0-b1ea-b338ff3c1032 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5eb37f69-48c5-4bb0-b1ea-b338ff3c1032 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:04 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-5eb37f69-48c5-4bb0-b1ea-b338ff3c1032 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:07:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5eb37f69-48c5-4bb0-b1ea-b338ff3c1032 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 200 len: 1533 microversion: 2.1 time: 0.225965 Nov 28 07:07:04 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 384/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:07:04 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 1533 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:29 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=64871) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 07:07:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f3bd1116-59f8-43f5-a8bd-65932a38a7ba tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.125676 Nov 28 07:07:29 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 381/1155] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 07:07:29 2023] POST /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=14 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a7ac3ceb-1352-4448-9fac-10b3943faced tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a7ac3ceb-1352-4448-9fac-10b3943faced tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a7ac3ceb-1352-4448-9fac-10b3943faced tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a7ac3ceb-1352-4448-9fac-10b3943faced tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a7ac3ceb-1352-4448-9fac-10b3943faced tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a7ac3ceb-1352-4448-9fac-10b3943faced tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a7ac3ceb-1352-4448-9fac-10b3943faced tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a7ac3ceb-1352-4448-9fac-10b3943faced tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:29 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-a7ac3ceb-1352-4448-9fac-10b3943faced tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a54dae1189f7405eb8b8b1aefe0b6ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9fb47f7da246f9b569ca12206c5726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:07:29 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a7ac3ceb-1352-4448-9fac-10b3943faced tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe" status: 200 len: 1504 microversion: 2.1 time: 0.381706 Nov 28 07:07:29 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 391/1156] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:07:29 2023] GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:07:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=10 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:07:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] Creating event network-changed:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:07:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-86d63560-ad61-4b18-b85b-9c831504cdfc req-32216c53-f378-46db-9ca9-39b83a67b398 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136152 Nov 28 07:07:38 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 385/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:07:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:07:41 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:41 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:41 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "name": "network-vif-plugged", "status": "completed", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:07:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] Creating event network-vif-plugged:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:07:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-5a081548-5a13-400f-8cf6-6c0cafc6ba46 req-fbb4d6c7-48b1-4c84-9a5b-909d9ac821a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044180 Nov 28 07:07:41 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 382/1158] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:07:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:07:43 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:43 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "name": "network-vif-plugged", "status": "completed", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:07:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] Creating event network-vif-plugged:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:07:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-c309deef-dff2-4348-a722-e3d4f7ad6050 req-d59e913e-891e-45a7-bf86-a14e256785b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035132 Nov 28 07:07:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 392/1159] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:07:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:07:46 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:07:46 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:07:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:46 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance f112048f-4224-409f-bb75-63eb252c6097 could not be found. Nov 28 07:07:46 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance f112048f-4224-409f-bb75-63eb252c6097 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:07:46 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-85834a14-3dd1-4917-b34d-85ad7080e34f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097" status: 404 len: 111 microversion: 2.1 time: 0.032974 Nov 28 07:07:46 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 386/1160] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:07:46 2023] GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:07:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1618794767", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-83750153"}], "block_device_mapping_v2": [{"uuid": "fba423b6-1127-46d5-a9a7-87dd41849861", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-1183583656", "networks": [{"uuid": "7d507ecb-7146-47b0-98b6-2939026c2b05"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] validate_networks() for [('7d507ecb-7146-47b0-98b6-2939026c2b05', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for user 2139976b453e4bd2b8e83e551a0cc772 and project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 07:07:47 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fba423b6-1127-46d5-a9a7-87dd41849861',volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 07:07:47 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-2ac5a89d-ecc4-4569-8eed-68c15cd03c5e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.847247 Nov 28 07:07:47 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 383/1161] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 07:07:46 2023] POST /compute/v2.1/servers => generated 402 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 07:07:47 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6c754b76-1730-42e6-8f55-fe306b4b84a0 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:07:47 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-6c754b76-1730-42e6-8f55-fe306b4b84a0 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:07:47 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-6c754b76-1730-42e6-8f55-fe306b4b84a0 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:07:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-6c754b76-1730-42e6-8f55-fe306b4b84a0 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b" status: 200 len: 1088 microversion: 2.1 time: 0.099966 Nov 28 07:07:47 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 393/1162] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:07:47 2023] GET /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b => generated 1088 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:07:49 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4f1347-91b0-40ac-9190-889e27afba0b", "tag": "d7a4564b-b7fb-4f25-8afd-a74624159c8b"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:07:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:49 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] Creating event network-changed:d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance 5c4f1347-91b0-40ac-9190-889e27afba0b on user Nov 28 07:07:49 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-fb6f20d7-96de-457d-9f72-da5a6c81de7a req-4fc97c77-f8b8-4487-9abe-4640899f422a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029919 Nov 28 07:07:49 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 387/1163] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:07:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:07:58 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:58 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:58 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:58 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:07:58 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4f1347-91b0-40ac-9190-889e27afba0b", "name": "network-vif-plugged", "status": "completed", "tag": "d7a4564b-b7fb-4f25-8afd-a74624159c8b"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:07:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:07:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:07:58 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:07:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] Creating event network-vif-plugged:d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance 5c4f1347-91b0-40ac-9190-889e27afba0b on user Nov 28 07:07:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-d54891aa-d72d-403a-82cc-c928dc08bc24 req-f698b861-2342-4d5c-bbe0-119c305a7383 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067755 Nov 28 07:07:58 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 384/1164] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:07:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:08:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4f1347-91b0-40ac-9190-889e27afba0b", "name": "network-vif-plugged", "status": "completed", "tag": "d7a4564b-b7fb-4f25-8afd-a74624159c8b"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:08:00 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:00 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:00 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] Creating event network-vif-plugged:d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance 5c4f1347-91b0-40ac-9190-889e27afba0b on user Nov 28 07:08:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-ca087d12-82f7-4379-8c5c-56ac8f49a937 req-8288467a-0edf-43b9-9804-0f0543d3f98b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038144 Nov 28 07:08:00 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 394/1165] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:08:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-90a72b0f-68b8-4836-bdd0-ea3286485a45 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-90a72b0f-68b8-4836-bdd0-ea3286485a45 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-90a72b0f-68b8-4836-bdd0-ea3286485a45 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-90a72b0f-68b8-4836-bdd0-ea3286485a45 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-90a72b0f-68b8-4836-bdd0-ea3286485a45 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-90a72b0f-68b8-4836-bdd0-ea3286485a45 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-90a72b0f-68b8-4836-bdd0-ea3286485a45 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-90a72b0f-68b8-4836-bdd0-ea3286485a45 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:04 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-90a72b0f-68b8-4836-bdd0-ea3286485a45 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:08:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-90a72b0f-68b8-4836-bdd0-ea3286485a45 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 200 len: 1533 microversion: 2.1 time: 0.237824 Nov 28 07:08:04 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 388/1166] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:08:04 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 1533 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:08:04 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:08:04 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:08:04 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching by: {'deleted': False, 'project_id': '3af4e4870f934158819e183bbc7b499e'} {{(pid=64871) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 07:08:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:04 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:04 user devstack@n-api.service[64871]: DEBUG nova.compute.multi_cell_list [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 07:08:04 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-63efd06b-8983-4fdc-98f8-aa9f8b17a54e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.066497 Nov 28 07:08:04 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 385/1167] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 07:08:04 2023] GET /compute/v2.1/servers => generated 339 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:08:04 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-48c43f6c-04e4-40b6-a1fc-139fd762915f tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:08:04 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-48c43f6c-04e4-40b6-a1fc-139fd762915f tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:08:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48c43f6c-04e4-40b6-a1fc-139fd762915f tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48c43f6c-04e4-40b6-a1fc-139fd762915f tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48c43f6c-04e4-40b6-a1fc-139fd762915f tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48c43f6c-04e4-40b6-a1fc-139fd762915f tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48c43f6c-04e4-40b6-a1fc-139fd762915f tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:04 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48c43f6c-04e4-40b6-a1fc-139fd762915f tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:05 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-48c43f6c-04e4-40b6-a1fc-139fd762915f tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:08:05 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-48c43f6c-04e4-40b6-a1fc-139fd762915f tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 200 len: 1533 microversion: 2.1 time: 0.242830 Nov 28 07:08:05 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 395/1168] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:08:04 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 1533 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:08:07 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6996258-ad77-4f65-b6c2-ea5ab46cae9d"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:08:07 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:08:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5b8f1b91-f267-46fd-af61-ec749188038e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260532 Nov 28 07:08:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 389/1169] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:08:07 2023] POST /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-96c79c94-a026-4e8f-a438-d19f3d935690 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-96c79c94-a026-4e8f-a438-d19f3d935690 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=10 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96c79c94-a026-4e8f-a438-d19f3d935690 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96c79c94-a026-4e8f-a438-d19f3d935690 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96c79c94-a026-4e8f-a438-d19f3d935690 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96c79c94-a026-4e8f-a438-d19f3d935690 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96c79c94-a026-4e8f-a438-d19f3d935690 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-96c79c94-a026-4e8f-a438-d19f3d935690 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:20 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-96c79c94-a026-4e8f-a438-d19f3d935690 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a54dae1189f7405eb8b8b1aefe0b6ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9fb47f7da246f9b569ca12206c5726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:08:20 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-96c79c94-a026-4e8f-a438-d19f3d935690 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe" status: 200 len: 1549 microversion: 2.1 time: 0.231010 Nov 28 07:08:20 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 386/1170] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:08:20 2023] GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe => generated 1549 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-ebb2a2d1-ffe6-4fe5-9b67-9b9ca128a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-ebb2a2d1-ffe6-4fe5-9b67-9b9ca128a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=8 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ebb2a2d1-ffe6-4fe5-9b67-9b9ca128a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ebb2a2d1-ffe6-4fe5-9b67-9b9ca128a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ebb2a2d1-ffe6-4fe5-9b67-9b9ca128a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ebb2a2d1-ffe6-4fe5-9b67-9b9ca128a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ebb2a2d1-ffe6-4fe5-9b67-9b9ca128a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-ebb2a2d1-ffe6-4fe5-9b67-9b9ca128a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:21 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-ebb2a2d1-ffe6-4fe5-9b67-9b9ca128a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:08:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-ebb2a2d1-ffe6-4fe5-9b67-9b9ca128a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 200 len: 1579 microversion: 2.1 time: 0.200785 Nov 28 07:08:21 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 396/1171] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:08:21 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 1579 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:08:22 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:22 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:08:22 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:08:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] Creating event network-changed:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:08:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-6d0ae689-99ea-455e-8885-b292dac20881 req-dd7df4f0-6527-421d-84be-78d78d67ab83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036898 Nov 28 07:08:22 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 390/1172] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:08:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:08:24 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6da4410e-65c6-4fbf-a40a-1782a9fed04e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-529706114"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:08:24 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-6da4410e-65c6-4fbf-a40a-1782a9fed04e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:08:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6da4410e-65c6-4fbf-a40a-1782a9fed04e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6da4410e-65c6-4fbf-a40a-1782a9fed04e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6da4410e-65c6-4fbf-a40a-1782a9fed04e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6da4410e-65c6-4fbf-a40a-1782a9fed04e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6da4410e-65c6-4fbf-a40a-1782a9fed04e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-6da4410e-65c6-4fbf-a40a-1782a9fed04e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:24 user devstack@n-api.service[64871]: INFO nova.network.security_group_api [None req-6da4410e-65c6-4fbf-a40a-1782a9fed04e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Adding security group fc00cf68-ebab-4a20-9333-d82459ae152c to port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 Nov 28 07:08:24 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6da4410e-65c6-4fbf-a40a-1782a9fed04e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/action" status: 202 len: 0 microversion: 2.1 time: 0.654975 Nov 28 07:08:24 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 387/1173] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 07:08:24 2023] POST /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:08:24 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1cb0eb55-f130-4430-beb6-a89712a949de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:08:24 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1cb0eb55-f130-4430-beb6-a89712a949de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:08:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1cb0eb55-f130-4430-beb6-a89712a949de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1cb0eb55-f130-4430-beb6-a89712a949de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1cb0eb55-f130-4430-beb6-a89712a949de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1cb0eb55-f130-4430-beb6-a89712a949de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1cb0eb55-f130-4430-beb6-a89712a949de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:24 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-1cb0eb55-f130-4430-beb6-a89712a949de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:08:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] Creating event network-changed:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:08:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-a3b17871-a672-4769-8b21-7177896faa10 req-eb35289a-c8b0-461c-810a-84553a016eb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030914 Nov 28 07:08:25 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 391/1174] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:08:25 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1cb0eb55-f130-4430-beb6-a89712a949de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:08:25 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1cb0eb55-f130-4430-beb6-a89712a949de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 200 len: 1744 microversion: 2.1 time: 0.193218 Nov 28 07:08:25 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 397/1175] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:08:24 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:08:28 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:08:28 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:08:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-81d0597a-2c01-4332-93e4-e553648fb9ce tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/action" status: 202 len: 0 microversion: 2.1 time: 0.105514 Nov 28 07:08:28 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 388/1176] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 07:08:28 2023] POST /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:08:28 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-3666e4d8-d8b5-4da4-ac85-099c2c45d550 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:08:28 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-3666e4d8-d8b5-4da4-ac85-099c2c45d550 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:08:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3666e4d8-d8b5-4da4-ac85-099c2c45d550 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3666e4d8-d8b5-4da4-ac85-099c2c45d550 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3666e4d8-d8b5-4da4-ac85-099c2c45d550 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3666e4d8-d8b5-4da4-ac85-099c2c45d550 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3666e4d8-d8b5-4da4-ac85-099c2c45d550 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:28 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-3666e4d8-d8b5-4da4-ac85-099c2c45d550 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:29 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-3666e4d8-d8b5-4da4-ac85-099c2c45d550 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:08:29 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-3666e4d8-d8b5-4da4-ac85-099c2c45d550 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 200 len: 1746 microversion: 2.1 time: 0.691842 Nov 28 07:08:29 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 392/1177] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:08:28 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 1746 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:08:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-unplugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:08:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] Creating event network-vif-unplugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:08:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-55181973-095a-4cff-971f-397063e4bd22 req-68a9ed68-3ca0-468f-bef4-548ac7fb21ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.232934 Nov 28 07:08:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 398/1178] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:08:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:08:32 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-plugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:08:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:32 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] Creating event network-vif-plugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:08:32 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-ef28cd54-babd-4613-a062-224744d1406f req-8397c909-17b6-4e84-bdc9-c5e9b868aca8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034758 Nov 28 07:08:32 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 389/1179] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:08:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:08:34 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-plugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:08:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] Creating event network-vif-plugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:08:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e0176d3d-2574-4e87-9336-da9f563b4cea req-c127c1f9-6b65-4062-95d6-efc32957a000 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029721 Nov 28 07:08:34 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 393/1180] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:08:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:08:36 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-plugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:08:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:36 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:36 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] Creating event network-vif-plugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:08:36 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-81278842-9ab1-49ab-9b9c-05b77296c948 req-155d011e-c3ca-404d-8ff3-b4e68f2c5e9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035565 Nov 28 07:08:36 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 399/1181] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:08:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:08:37 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ccd37134-338e-4a68-876a-c52a1b175342 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:08:37 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ccd37134-338e-4a68-876a-c52a1b175342 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:08:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ccd37134-338e-4a68-876a-c52a1b175342 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ccd37134-338e-4a68-876a-c52a1b175342 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ccd37134-338e-4a68-876a-c52a1b175342 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ccd37134-338e-4a68-876a-c52a1b175342 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:08:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ccd37134-338e-4a68-876a-c52a1b175342 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:08:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ccd37134-338e-4a68-876a-c52a1b175342 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:08:38 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-ccd37134-338e-4a68-876a-c52a1b175342 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:08:38 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ccd37134-338e-4a68-876a-c52a1b175342 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b" status: 200 len: 1439 microversion: 2.1 time: 0.308717 Nov 28 07:08:38 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 390/1182] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:08:37 2023] GET /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b => generated 1439 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:09:19 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=8 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:19 user devstack@n-api.service[64873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 07:09:19 user devstack@n-api.service[64873]: Tue Nov 28 07:09:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 (ip 10.0.0.210) !!! Nov 28 07:09:19 user devstack@n-api.service[64873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 07:09:19 user devstack@n-api.service[64873]: Tue Nov 28 07:09:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 (ip 10.0.0.210) !!! Nov 28 07:09:19 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=12 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:19 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e2ab496f-b605-45bf-8d86-b7cd5823501e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:09:19 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e2ab496f-b605-45bf-8d86-b7cd5823501e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:09:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e2ab496f-b605-45bf-8d86-b7cd5823501e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e2ab496f-b605-45bf-8d86-b7cd5823501e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e2ab496f-b605-45bf-8d86-b7cd5823501e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e2ab496f-b605-45bf-8d86-b7cd5823501e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e2ab496f-b605-45bf-8d86-b7cd5823501e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:19 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e2ab496f-b605-45bf-8d86-b7cd5823501e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:20 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-e2ab496f-b605-45bf-8d86-b7cd5823501e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:09:20 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e2ab496f-b605-45bf-8d86-b7cd5823501e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 200 len: 1744 microversion: 2.1 time: 0.320595 Nov 28 07:09:20 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 394/1183] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:09:19 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 1744 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=8 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:21 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=10 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:21 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=16 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:21 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:09:21 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:09:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] Creating event network-changed:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:09:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-75b3d42e-ce78-403c-a731-b615b169ce2e req-ad057cc5-0013-4b1c-9034-857f05465095 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093125 Nov 28 07:09:21 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 391/1184] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:09:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:09:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a41cb9ed-f9ce-479e-bad2-93b9f7472066 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe" status: 204 len: 0 microversion: 2.1 time: 0.180754 Nov 28 07:09:21 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 400/1185] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:09:21 2023] DELETE /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:09:21 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-25945efd-2086-493a-b93f-c30bb3960d9e tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:09:21 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-25945efd-2086-493a-b93f-c30bb3960d9e tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:09:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-25945efd-2086-493a-b93f-c30bb3960d9e tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-25945efd-2086-493a-b93f-c30bb3960d9e tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-25945efd-2086-493a-b93f-c30bb3960d9e tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-25945efd-2086-493a-b93f-c30bb3960d9e tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-25945efd-2086-493a-b93f-c30bb3960d9e tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-25945efd-2086-493a-b93f-c30bb3960d9e tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:21 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "name": "network-vif-unplugged", "status": "completed", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:09:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:21 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] Creating event network-vif-unplugged:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:09:21 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-9bfb0e43-b810-4e51-b7c9-daf83755893c req-dfa9aab8-5c38-4899-8911-42b7f1c36764 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042120 Nov 28 07:09:21 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 392/1186] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:09:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:09:21 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-25945efd-2086-493a-b93f-c30bb3960d9e tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a54dae1189f7405eb8b8b1aefe0b6ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9fb47f7da246f9b569ca12206c5726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:09:21 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-25945efd-2086-493a-b93f-c30bb3960d9e tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe" status: 200 len: 1555 microversion: 2.1 time: 0.460887 Nov 28 07:09:21 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 395/1187] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:09:21 2023] GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe => generated 1555 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:09:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-c0e1ab01-1b0e-43cc-ab5f-91400103a173 req-f751b599-cd2f-47b5-9c90-75803dd74f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "name": "network-vif-deleted", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:09:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c0e1ab01-1b0e-43cc-ab5f-91400103a173 req-f751b599-cd2f-47b5-9c90-75803dd74f9e service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c0e1ab01-1b0e-43cc-ab5f-91400103a173 req-f751b599-cd2f-47b5-9c90-75803dd74f9e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:23 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c0e1ab01-1b0e-43cc-ab5f-91400103a173 req-f751b599-cd2f-47b5-9c90-75803dd74f9e service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:23 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-c0e1ab01-1b0e-43cc-ab5f-91400103a173 req-f751b599-cd2f-47b5-9c90-75803dd74f9e service nova] Creating event network-vif-deleted:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:09:23 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-c0e1ab01-1b0e-43cc-ab5f-91400103a173 req-f751b599-cd2f-47b5-9c90-75803dd74f9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 Nov 28 07:09:23 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 401/1188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:09:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:09:23 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a69c84f-a030-4262-8f84-7d4bd72db3fe", "name": "network-vif-plugged", "status": "completed", "tag": "3edba92c-a2b6-485d-985d-00a244d7207f"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:09:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:23 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] Creating event network-vif-plugged:3edba92c-a2b6-485d-985d-00a244d7207f for instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe on user Nov 28 07:09:23 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-f9c52101-e758-44d9-ad67-be2ab8ac3d13 req-4f7ab5d9-2b1f-48ad-8161-8081a5e69044 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Nov 28 07:09:23 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 393/1189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:09:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-79dc1333-2ec5-46c8-aaa4-810c10522250 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-79dc1333-2ec5-46c8-aaa4-810c10522250 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=12 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-79dc1333-2ec5-46c8-aaa4-810c10522250 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-79dc1333-2ec5-46c8-aaa4-810c10522250 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-79dc1333-2ec5-46c8-aaa4-810c10522250 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-79dc1333-2ec5-46c8-aaa4-810c10522250 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-79dc1333-2ec5-46c8-aaa4-810c10522250 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-79dc1333-2ec5-46c8-aaa4-810c10522250 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:38 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-79dc1333-2ec5-46c8-aaa4-810c10522250 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:09:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-79dc1333-2ec5-46c8-aaa4-810c10522250 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b" status: 200 len: 1439 microversion: 2.1 time: 0.380672 Nov 28 07:09:38 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 396/1190] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:09:38 2023] GET /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b => generated 1439 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:09:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4f1347-91b0-40ac-9190-889e27afba0b", "tag": "d7a4564b-b7fb-4f25-8afd-a74624159c8b"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:09:40 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:40 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] Creating event network-changed:d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance 5c4f1347-91b0-40ac-9190-889e27afba0b on user Nov 28 07:09:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-ea8fab12-218d-45a3-be1f-778480da6979 req-1252c8ac-459b-48ef-8e77-e0319c5e8b0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038726 Nov 28 07:09:40 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 402/1191] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:09:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1493339524", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-83750153"}], "block_device_mapping_v2": [{"uuid": "8910b4cd-fecb-411d-89e6-d63b7023bd44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-1183583656", "networks": [{"uuid": "7d507ecb-7146-47b0-98b6-2939026c2b05"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] validate_networks() for [('7d507ecb-7146-47b0-98b6-2939026c2b05', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Getting quotas for user 2139976b453e4bd2b8e83e551a0cc772 and project cecfa8e54acf42a8affd8686f500d6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 07:09:46 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8910b4cd-fecb-411d-89e6-d63b7023bd44',volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 07:09:47 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-2f03bbc3-c171-4e92-a3ad-b22e91418757 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.777126 Nov 28 07:09:47 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 394/1192] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 07:09:46 2023] POST /compute/v2.1/servers => generated 402 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 07:09:47 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-1205686f-065d-41da-89ad-aa6d3f561eba tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:09:47 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-1205686f-065d-41da-89ad-aa6d3f561eba tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:09:47 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-1205686f-065d-41da-89ad-aa6d3f561eba tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:09:47 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-1205686f-065d-41da-89ad-aa6d3f561eba tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda" status: 200 len: 1088 microversion: 2.1 time: 0.075847 Nov 28 07:09:47 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 397/1193] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:09:47 2023] GET /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:09:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7bf4ad-7016-44a6-b27a-6dac06f10bda", "tag": "663ecf4e-8168-49a1-80d0-f13f491f4b06"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:09:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] Creating event network-changed:663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda on user Nov 28 07:09:49 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-e5620b8c-4bef-4c1b-aa86-7cbb9ae75dfa req-5dad999f-1ea0-475d-8ad2-b6e73526ab1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039741 Nov 28 07:09:49 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 403/1194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:09:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:09:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7bf4ad-7016-44a6-b27a-6dac06f10bda", "name": "network-vif-plugged", "status": "completed", "tag": "663ecf4e-8168-49a1-80d0-f13f491f4b06"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:09:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:09:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:09:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:09:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:09:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] Creating event network-vif-plugged:663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda on user Nov 28 07:09:58 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-be498255-3e16-4b77-90bf-53444f2c5f73 req-42af1ee4-ee71-45ab-a1fe-d52a43c65d59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040349 Nov 28 07:09:58 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 395/1195] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:09:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:10:00 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7bf4ad-7016-44a6-b27a-6dac06f10bda", "name": "network-vif-plugged", "status": "completed", "tag": "663ecf4e-8168-49a1-80d0-f13f491f4b06"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:10:00 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:00 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:00 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] Creating event network-vif-plugged:663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda on user Nov 28 07:10:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-39a03088-75ca-4fc7-9623-9c87ef7c4e7d req-e9e38826-45b9-4560-9275-a03e96e6fb8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041507 Nov 28 07:10:00 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 398/1196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:10:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:10:11 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:11 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:11 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:10:11 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] [instance: 6a69c84f-a030-4262-8f84-7d4bd72db3fe] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:10:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:11 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:12 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] HTTP exception thrown: Instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe could not be found. Nov 28 07:10:12 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Returning 404 to user: Instance 6a69c84f-a030-4262-8f84-7d4bd72db3fe could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:10:12 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-0dc41f92-341e-47a5-b887-69f98cfebad0 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe" status: 404 len: 111 microversion: 2.1 time: 0.036740 Nov 28 07:10:12 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 404/1197] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:10:11 2023] GET /compute/v2.1/servers/6a69c84f-a030-4262-8f84-7d4bd72db3fe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:10:12 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:12 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:12 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-54a65ba6-2dd5-425c-99da-f00bbb137839 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] Calling method '.version_select at 0x7f0b035a0c10>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:10:12 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-54a65ba6-2dd5-425c-99da-f00bbb137839 tempest-TestShelveInstance-1756841419 tempest-TestShelveInstance-1756841419-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1887206196" status: 202 len: 0 microversion: 2.1 time: 0.049891 Nov 28 07:10:12 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 396/1198] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Nov 28 07:10:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1887206196 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:10:20 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:20 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:20 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-aa395352-816d-4eac-8d0f-b33d426bf67d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-529706114"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:10:20 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-aa395352-816d-4eac-8d0f-b33d426bf67d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:10:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa395352-816d-4eac-8d0f-b33d426bf67d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa395352-816d-4eac-8d0f-b33d426bf67d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa395352-816d-4eac-8d0f-b33d426bf67d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa395352-816d-4eac-8d0f-b33d426bf67d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa395352-816d-4eac-8d0f-b33d426bf67d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:20 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-aa395352-816d-4eac-8d0f-b33d426bf67d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:20 user devstack@n-api.service[64873]: INFO nova.network.security_group_api [None req-aa395352-816d-4eac-8d0f-b33d426bf67d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Removing security group fc00cf68-ebab-4a20-9333-d82459ae152c from port 7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 Nov 28 07:10:21 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-aa395352-816d-4eac-8d0f-b33d426bf67d tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/action" status: 202 len: 0 microversion: 2.1 time: 0.587666 Nov 28 07:10:21 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 399/1199] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 07:10:20 2023] POST /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:10:21 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:10:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] Creating event network-changed:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:10:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-40190d1c-50b3-4c5e-9d9f-c22b1f469c77 req-43e1f56d-56e4-4334-a28d-02255cdf8f17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031160 Nov 28 07:10:21 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 405/1200] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:10:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:10:22 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:10:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:22 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] Creating event network-changed:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:10:22 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-d303f454-f549-459c-b06f-3964ccb6e680 req-8a989ea2-9111-4d61-a7dc-ba8765606598 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038038 Nov 28 07:10:22 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 397/1201] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:10:22 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:10:22 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:10:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:22 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'services' on Instance uuid aa43db78-a43a-4ef1-b458-12fb253aabd0 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:10:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5c314605-ff8b-408d-87e9-783eba6ba6b7 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/os-volume_attachments/d6996258-ad77-4f65-b6c2-ea5ab46cae9d" status: 202 len: 0 microversion: 2.1 time: 0.158489 Nov 28 07:10:22 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 400/1202] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:10:22 2023] DELETE /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/os-volume_attachments/d6996258-ad77-4f65-b6c2-ea5ab46cae9d => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:10:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-48933ddc-f74b-4fa0-a70d-df86686dc358 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:10:22 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-48933ddc-f74b-4fa0-a70d-df86686dc358 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:10:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48933ddc-f74b-4fa0-a70d-df86686dc358 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48933ddc-f74b-4fa0-a70d-df86686dc358 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48933ddc-f74b-4fa0-a70d-df86686dc358 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48933ddc-f74b-4fa0-a70d-df86686dc358 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48933ddc-f74b-4fa0-a70d-df86686dc358 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-48933ddc-f74b-4fa0-a70d-df86686dc358 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-48933ddc-f74b-4fa0-a70d-df86686dc358 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053117 Nov 28 07:10:22 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 406/1203] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:10:22 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:10:31 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-6429cbe0-1e6e-4740-8066-03c25e0d621b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Action: 'create', calling method: .version_select at 0x7f0b035a24d0>, body: {"keypair": {"name": "tempest-keypair-1050103458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3NrfXE/HrSeGiVxVbPsssOqTBM+VWsglMxdYixhqCA8Ly6ap7KrPQ6mUDJggU4QVaW7QjiWuqoy4r2ZNqGY/uAA8z2NhInCXcANojwzpuXmUChkJln9MGwgR9qpzyREg=="}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:10:31 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-6429cbe0-1e6e-4740-8066-03c25e0d621b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Getting quotas for project 799dd9fcfea94665b9b9a97393f442f2. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:10:31 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-6429cbe0-1e6e-4740-8066-03c25e0d621b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Getting quotas for user c6adcf7b17de430a81e4f3adbb800919 and project 799dd9fcfea94665b9b9a97393f442f2. Resources: {'key_pairs'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:10:31 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-6429cbe0-1e6e-4740-8066-03c25e0d621b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.273438 Nov 28 07:10:31 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 398/1204] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 07:10:30 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:10:34 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:34 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:34 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-769175374", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "key_name": "tempest-keypair-1050103458", "security_groups": [{"name": "tempest-secgroup-smoke-735307261"}, {"name": "tempest-securitygroup--1977074179"}], "networks": [{"uuid": "976a62e9-e249-4df0-a777-4e02de519ea9"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:10:34 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] validate_networks() for [('976a62e9-e249-4df0-a777-4e02de519ea9', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Getting quotas for project 799dd9fcfea94665b9b9a97393f442f2. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Getting quotas for user c6adcf7b17de430a81e4f3adbb800919 and project 799dd9fcfea94665b9b9a97393f442f2. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 07:10:35 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 07:10:35 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-9a1c840d-1669-4950-84e6-090e8db5a1cf tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 450 microversion: 2.1 time: 0.657668 Nov 28 07:10:35 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 401/1205] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 07:10:34 2023] POST /compute/v2.1/servers => generated 450 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 07:10:35 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5975fe08-7416-4265-8bda-d2c2fc0f78ad tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:10:35 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-5975fe08-7416-4265-8bda-d2c2fc0f78ad tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:10:35 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:35 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=10 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:35 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-5975fe08-7416-4265-8bda-d2c2fc0f78ad tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6adcf7b17de430a81e4f3adbb800919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dd9fcfea94665b9b9a97393f442f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:10:35 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-5975fe08-7416-4265-8bda-d2c2fc0f78ad tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294" status: 200 len: 1235 microversion: 2.1 time: 0.122295 Nov 28 07:10:35 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 407/1206] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:10:35 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294 => generated 1235 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:10:37 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:37 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ef8d8043-3417-48c9-853f-21c4c2587d70 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:10:37 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ef8d8043-3417-48c9-853f-21c4c2587d70 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:10:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef8d8043-3417-48c9-853f-21c4c2587d70 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef8d8043-3417-48c9-853f-21c4c2587d70 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef8d8043-3417-48c9-853f-21c4c2587d70 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef8d8043-3417-48c9-853f-21c4c2587d70 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef8d8043-3417-48c9-853f-21c4c2587d70 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef8d8043-3417-48c9-853f-21c4c2587d70 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:37 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-ef8d8043-3417-48c9-853f-21c4c2587d70 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:10:37 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ef8d8043-3417-48c9-853f-21c4c2587d70 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda" status: 200 len: 1439 microversion: 2.1 time: 0.353830 Nov 28 07:10:37 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 399/1207] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:10:37 2023] GET /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda => generated 1439 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:10:37 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdcf8d61-12d6-4698-9c25-907b4cdaf294", "tag": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:10:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:37 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:37 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] Creating event network-changed:ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 on user Nov 28 07:10:37 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-da50c152-2bda-4156-bf3a-069e35c1f457 req-5212c941-db4a-4f03-a342-4ab260194daa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027204 Nov 28 07:10:37 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 402/1208] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:10:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:10:39 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdcf8d61-12d6-4698-9c25-907b4cdaf294", "name": "network-vif-plugged", "status": "completed", "tag": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:10:39 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:39 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:39 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:39 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] Creating event network-vif-plugged:ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 on user Nov 28 07:10:39 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-16b84b30-df0f-46df-aad9-6bd4a6c9baa3 req-55b3b9c4-ffce-4667-a3e0-2ef71bfa3359 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064645 Nov 28 07:10:39 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 408/1209] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:10:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:10:41 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdcf8d61-12d6-4698-9c25-907b4cdaf294", "name": "network-vif-plugged", "status": "completed", "tag": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:10:41 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:10:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:10:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:10:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:10:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] Creating event network-vif-plugged:ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 on user Nov 28 07:10:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-e28b338f-0ec7-4b52-8bc0-55762706b827 req-19905a02-6c76-43fa-b067-cd9cfd065e91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034250 Nov 28 07:10:41 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 400/1210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-233562bc-579a-4b9d-b9c9-0640a6d464b9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-233562bc-579a-4b9d-b9c9-0640a6d464b9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-233562bc-579a-4b9d-b9c9-0640a6d464b9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-233562bc-579a-4b9d-b9c9-0640a6d464b9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-233562bc-579a-4b9d-b9c9-0640a6d464b9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-233562bc-579a-4b9d-b9c9-0640a6d464b9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-233562bc-579a-4b9d-b9c9-0640a6d464b9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-233562bc-579a-4b9d-b9c9-0640a6d464b9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-233562bc-579a-4b9d-b9c9-0640a6d464b9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.193593 Nov 28 07:11:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 403/1211] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:11:12 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:12 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] HTTP exception thrown: Instance aa43db78-a43a-4ef1-b458-12fb253aabd0 is not attached to volume d6996258-ad77-4f65-b6c2-ea5ab46cae9d Nov 28 07:11:12 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Returning 404 to user: Instance aa43db78-a43a-4ef1-b458-12fb253aabd0 is not attached to volume d6996258-ad77-4f65-b6c2-ea5ab46cae9d {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:11:12 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-5cdb2223-f1cb-43bd-abdd-ce5d229081de tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/os-volume_attachments/d6996258-ad77-4f65-b6c2-ea5ab46cae9d" status: 404 len: 154 microversion: 2.1 time: 0.115875 Nov 28 07:11:12 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 409/1212] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:11:12 2023] DELETE /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0/os-volume_attachments/d6996258-ad77-4f65-b6c2-ea5ab46cae9d => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:11:15 user devstack@n-api.service[64871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1ae8178a-5938-4e4b-aad4-0d28d1beb089] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 07:11:15 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:15 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=8 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:15 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:11:15 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:11:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:15 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:16 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:11:16 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-55930996-b04e-47c1-b6a6-145a0e448929 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 204 len: 0 microversion: 2.1 time: 0.186539 Nov 28 07:11:16 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 401/1213] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:11:15 2023] DELETE /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:11:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6b070c01-a3ec-4d1e-bb51-d221d9d08560 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:11:16 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6b070c01-a3ec-4d1e-bb51-d221d9d08560 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:11:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b070c01-a3ec-4d1e-bb51-d221d9d08560 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b070c01-a3ec-4d1e-bb51-d221d9d08560 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b070c01-a3ec-4d1e-bb51-d221d9d08560 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b070c01-a3ec-4d1e-bb51-d221d9d08560 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b070c01-a3ec-4d1e-bb51-d221d9d08560 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6b070c01-a3ec-4d1e-bb51-d221d9d08560 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:16 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-6b070c01-a3ec-4d1e-bb51-d221d9d08560 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:11:16 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-unplugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:11:16 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6b070c01-a3ec-4d1e-bb51-d221d9d08560 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 200 len: 1539 microversion: 2.1 time: 0.234689 Nov 28 07:11:16 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 404/1214] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:11:16 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 1539 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:11:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] Creating event network-vif-unplugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:11:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-0aa2cc9a-1ed6-493c-9fb8-82a16b053484 req-666991f0-22db-4480-8e96-bee1058ecb99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029496 Nov 28 07:11:16 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 410/1215] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:11:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:11:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-a7232b4b-580d-42ef-a544-ff4390112397 req-77df8060-6a36-4706-a883-ebfe1cf80614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-deleted", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:11:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-a7232b4b-580d-42ef-a544-ff4390112397 req-77df8060-6a36-4706-a883-ebfe1cf80614 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-a7232b4b-580d-42ef-a544-ff4390112397 req-77df8060-6a36-4706-a883-ebfe1cf80614 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-a7232b4b-580d-42ef-a544-ff4390112397 req-77df8060-6a36-4706-a883-ebfe1cf80614 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-a7232b4b-580d-42ef-a544-ff4390112397 req-77df8060-6a36-4706-a883-ebfe1cf80614 service nova] Creating event network-vif-deleted:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:11:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-a7232b4b-580d-42ef-a544-ff4390112397 req-77df8060-6a36-4706-a883-ebfe1cf80614 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044502 Nov 28 07:11:17 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 402/1216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:11:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:11:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-plugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}, {"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-plugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}, {"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-plugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}, {"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-unplugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}, {"server_uuid": "aa43db78-a43a-4ef1-b458-12fb253aabd0", "name": "network-vif-plugged", "status": "completed", "tag": "7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:11:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Creating event network-vif-plugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:11:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Creating event network-vif-plugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:11:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Creating event network-vif-plugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:11:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Creating event network-vif-unplugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:11:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] Creating event network-vif-plugged:7ce415bb-a45f-4e5c-b1ec-a1504b6e0dd0 for instance aa43db78-a43a-4ef1-b458-12fb253aabd0 on user Nov 28 07:11:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e275b136-5d83-4d13-8889-1405859fe259 req-eb6cd62e-5280-4f5a-913e-1e17b72653dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030609 Nov 28 07:11:18 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 405/1217] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:11:18 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:11:25 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-911133e8-b7e1-4a63-b255-8d00112fed64 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:11:25 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-911133e8-b7e1-4a63-b255-8d00112fed64 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:11:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-911133e8-b7e1-4a63-b255-8d00112fed64 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-911133e8-b7e1-4a63-b255-8d00112fed64 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-911133e8-b7e1-4a63-b255-8d00112fed64 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-911133e8-b7e1-4a63-b255-8d00112fed64 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-911133e8-b7e1-4a63-b255-8d00112fed64 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:25 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-911133e8-b7e1-4a63-b255-8d00112fed64 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:25 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-911133e8-b7e1-4a63-b255-8d00112fed64 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6adcf7b17de430a81e4f3adbb800919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dd9fcfea94665b9b9a97393f442f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:11:25 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-911133e8-b7e1-4a63-b255-8d00112fed64 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294" status: 200 len: 1592 microversion: 2.1 time: 0.269471 Nov 28 07:11:25 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 411/1218] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:11:25 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294 => generated 1592 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:37 user devstack@n-api.service[64871]: INFO oslo.messaging._drivers.impl_rabbit [-] [1ae8178a-5938-4e4b-aad4-0d28d1beb089] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 38940. Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-244bce7b-139b-4aca-b371-2c963a92dbbc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-244bce7b-139b-4aca-b371-2c963a92dbbc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-244bce7b-139b-4aca-b371-2c963a92dbbc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-244bce7b-139b-4aca-b371-2c963a92dbbc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-244bce7b-139b-4aca-b371-2c963a92dbbc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-244bce7b-139b-4aca-b371-2c963a92dbbc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-244bce7b-139b-4aca-b371-2c963a92dbbc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-244bce7b-139b-4aca-b371-2c963a92dbbc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:37 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-244bce7b-139b-4aca-b371-2c963a92dbbc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:11:37 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-244bce7b-139b-4aca-b371-2c963a92dbbc tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda" status: 200 len: 1439 microversion: 2.1 time: 0.243011 Nov 28 07:11:37 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 403/1219] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:11:37 2023] GET /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda => generated 1439 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:11:39 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7bf4ad-7016-44a6-b27a-6dac06f10bda", "tag": "663ecf4e-8168-49a1-80d0-f13f491f4b06"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:11:39 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:39 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=14 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] Creating event network-changed:663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda on user Nov 28 07:11:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-757008b5-9af7-4fb0-b210-2749b765ec75 req-f16db4f0-ffe0-46d0-95a9-ba52d935c4ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034091 Nov 28 07:11:39 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 406/1220] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:11:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:11:41 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7bf4ad-7016-44a6-b27a-6dac06f10bda", "tag": "663ecf4e-8168-49a1-80d0-f13f491f4b06"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=14 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:11:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] Creating event network-changed:663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda on user Nov 28 07:11:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-db064532-5ef0-4285-adb4-62bb6256e380 req-93253b1d-f296-45ae-b77c-5581b0e10839 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027679 Nov 28 07:11:41 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 404/1221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:11:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:11:41 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:11:41 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e6f5cb51-14f1-4042-a3c7-8ecda113fb30 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda" status: 204 len: 0 microversion: 2.1 time: 0.122973 Nov 28 07:11:41 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 412/1222] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:11:41 2023] DELETE /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:11:41 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-d703eff5-b2bb-481b-97e6-7d5058fbcd1e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:11:41 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-d703eff5-b2bb-481b-97e6-7d5058fbcd1e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:11:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d703eff5-b2bb-481b-97e6-7d5058fbcd1e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d703eff5-b2bb-481b-97e6-7d5058fbcd1e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d703eff5-b2bb-481b-97e6-7d5058fbcd1e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d703eff5-b2bb-481b-97e6-7d5058fbcd1e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d703eff5-b2bb-481b-97e6-7d5058fbcd1e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-d703eff5-b2bb-481b-97e6-7d5058fbcd1e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:41 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7bf4ad-7016-44a6-b27a-6dac06f10bda", "name": "network-vif-unplugged", "status": "completed", "tag": "663ecf4e-8168-49a1-80d0-f13f491f4b06"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:11:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:41 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:41 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-d703eff5-b2bb-481b-97e6-7d5058fbcd1e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:11:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-d703eff5-b2bb-481b-97e6-7d5058fbcd1e tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda" status: 200 len: 1564 microversion: 2.1 time: 0.217677 Nov 28 07:11:41 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 407/1223] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:11:41 2023] GET /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda => generated 1564 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:11:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] Creating event network-vif-unplugged:663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda on user Nov 28 07:11:41 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-ceda2785-ba10-4386-8c1d-cc20b84d7cf8 req-802570e3-4775-40fd-9a16-fbfdb2e04b86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040918 Nov 28 07:11:41 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 405/1224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:11:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:11:43 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-9ee8ebf8-8417-4eb0-92ae-1f6017899b09 req-c7ccab2d-e9e0-4d43-ad3c-b0eb36e5dbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7bf4ad-7016-44a6-b27a-6dac06f10bda", "name": "network-vif-deleted", "tag": "663ecf4e-8168-49a1-80d0-f13f491f4b06"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:11:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9ee8ebf8-8417-4eb0-92ae-1f6017899b09 req-c7ccab2d-e9e0-4d43-ad3c-b0eb36e5dbd1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9ee8ebf8-8417-4eb0-92ae-1f6017899b09 req-c7ccab2d-e9e0-4d43-ad3c-b0eb36e5dbd1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:43 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9ee8ebf8-8417-4eb0-92ae-1f6017899b09 req-c7ccab2d-e9e0-4d43-ad3c-b0eb36e5dbd1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-9ee8ebf8-8417-4eb0-92ae-1f6017899b09 req-c7ccab2d-e9e0-4d43-ad3c-b0eb36e5dbd1 service nova] Creating event network-vif-deleted:663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda on user Nov 28 07:11:43 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-9ee8ebf8-8417-4eb0-92ae-1f6017899b09 req-c7ccab2d-e9e0-4d43-ad3c-b0eb36e5dbd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029810 Nov 28 07:11:43 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 413/1225] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:11:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:11:43 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7bf4ad-7016-44a6-b27a-6dac06f10bda", "name": "network-vif-plugged", "status": "completed", "tag": "663ecf4e-8168-49a1-80d0-f13f491f4b06"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:11:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:11:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:11:43 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:11:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] Creating event network-vif-plugged:663ecf4e-8168-49a1-80d0-f13f491f4b06 for instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda on user Nov 28 07:11:43 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-f5cbec1e-c914-41f9-9483-dbc4b70806da req-6fffd322-5b4c-463b-bd7d-3cae5b6c2a8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030212 Nov 28 07:11:43 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 408/1226] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:11:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: aa43db78-a43a-4ef1-b458-12fb253aabd0] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=10 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] HTTP exception thrown: Instance aa43db78-a43a-4ef1-b458-12fb253aabd0 could not be found. Nov 28 07:12:06 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Returning 404 to user: Instance aa43db78-a43a-4ef1-b458-12fb253aabd0 could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:12:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-ef645023-4244-4fa0-b721-731bf80cf3a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0" status: 404 len: 111 microversion: 2.1 time: 0.031615 Nov 28 07:12:06 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 406/1227] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:12:06 2023] GET /compute/v2.1/servers/aa43db78-a43a-4ef1-b458-12fb253aabd0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:12:06 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:06 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:06 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-914e34cf-82c7-4dbe-b425-506dc318d485 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '.version_select at 0x7f0b03457760>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:06 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-914e34cf-82c7-4dbe-b425-506dc318d485 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1018447659" status: 202 len: 0 microversion: 2.1 time: 0.035073 Nov 28 07:12:06 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 414/1228] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Nov 28 07:12:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1018447659 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:12:08 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:08 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=10 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-716649e0-a0be-45c2-8ec5-f963e3c960a9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'create', calling method: .version_select at 0x7f0b03adc4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-969944734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwPqiZCyo6mJK/w64EvOXbjK3caBU7kucGR/ZC7nBhAgDHRSY1giVJTJl4rBjkMG7le9zRcL3udFSbWodWNaBkhKXsBwWK1O8H0Hg+t+cENiIB2v3o91IrOcSoyndKxHw=="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:08 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-716649e0-a0be-45c2-8ec5-f963e3c960a9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting quotas for project 3af4e4870f934158819e183bbc7b499e. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:12:08 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-716649e0-a0be-45c2-8ec5-f963e3c960a9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting quotas for user 41da15820f7d43dfad1503c8d7355e6c and project 3af4e4870f934158819e183bbc7b499e. Resources: {'key_pairs'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:12:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-716649e0-a0be-45c2-8ec5-f963e3c960a9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049309 Nov 28 07:12:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 409/1229] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 07:12:08 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:08 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1439575737", "imageRef": "ba067348-4c02-4322-b6fa-c65ea1d8243b", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-969944734", "networks": [{"uuid": "dd15a0ea-6ca0-4839-b3c1-2e1006503361"}]}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:08 user devstack@n-api.service[64871]: DEBUG nova.network.neutron [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] validate_networks() for [('dd15a0ea-6ca0-4839-b3c1-2e1006503361', None, None, None, None, None)] {{(pid=64871) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flavor limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Image limits 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Flavor pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Image pref 0:0:0 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG nova.virt.hardware [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting quotas for project 3af4e4870f934158819e183bbc7b499e. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG nova.quota [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Getting quotas for user 41da15820f7d43dfad1503c8d7355e6c and project 3af4e4870f934158819e183bbc7b499e. Resources: {'instances', 'cores', 'ram'} {{(pid=64871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Going to run 1 instances... {{(pid=64871) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 07:12:09 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ba067348-4c02-4322-b6fa-c65ea1d8243b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 07:12:09 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c3ddf040-711a-4a79-b2b3-8cc166cf5b76 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.500420 Nov 28 07:12:09 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 407/1230] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 07:12:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 07:12:09 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-1cdac524-9393-4342-a45d-e5011fc52204 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:09 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-1cdac524-9393-4342-a45d-e5011fc52204 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:09 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-1cdac524-9393-4342-a45d-e5011fc52204 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:12:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-1cdac524-9393-4342-a45d-e5011fc52204 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 200 len: 1250 microversion: 2.1 time: 0.101101 Nov 28 07:12:09 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 415/1231] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:12:09 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 1250 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:12:11 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:11 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:11 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] Creating event network-changed:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:12:11 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-e95d317a-cde1-4d48-8d11-d5e3ba1a00e9 req-2bb1cd64-8f43-44a2-861e-df849b0e59b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Nov 28 07:12:11 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 410/1232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:12:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:13 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-plugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] Creating event network-vif-plugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:12:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-5d095004-393a-41af-9cc3-01839f857829 req-fe57d905-6f1c-4be6-9e56-207a52da56bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030673 Nov 28 07:12:13 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 408/1233] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:12:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-plugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:16 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] Creating event network-vif-plugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:12:16 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-12c521d5-7e51-416f-959f-b70a361acb79 req-7dcb00b8-fb5e-4b08-b4e4-9b1f352f2771 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037197 Nov 28 07:12:16 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 416/1234] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:12:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-24cd05a6-6970-42b1-948a-5007286aab36 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-24cd05a6-6970-42b1-948a-5007286aab36 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24cd05a6-6970-42b1-948a-5007286aab36 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24cd05a6-6970-42b1-948a-5007286aab36 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24cd05a6-6970-42b1-948a-5007286aab36 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24cd05a6-6970-42b1-948a-5007286aab36 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24cd05a6-6970-42b1-948a-5007286aab36 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:25 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-24cd05a6-6970-42b1-948a-5007286aab36 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:25 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-24cd05a6-6970-42b1-948a-5007286aab36 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.164705 Nov 28 07:12:25 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 411/1235] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 07:12:25 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-interface => generated 282 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:26 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:26 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:26 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:26 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:26 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdcf8d61-12d6-4698-9c25-907b4cdaf294", "tag": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:26 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:26 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] Creating event network-changed:ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 on user Nov 28 07:12:26 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-eaf3d130-46fe-4724-9a4f-c4b7f508a55e req-5a82374d-d6f4-4af6-9d30-c6bb9c701b75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037667 Nov 28 07:12:26 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 409/1236] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:12:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-4759073a-379f-4208-9530-a9de4b241b5b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-4759073a-379f-4208-9530-a9de4b241b5b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4759073a-379f-4208-9530-a9de4b241b5b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4759073a-379f-4208-9530-a9de4b241b5b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4759073a-379f-4208-9530-a9de4b241b5b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4759073a-379f-4208-9530-a9de4b241b5b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4759073a-379f-4208-9530-a9de4b241b5b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:27 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-4759073a-379f-4208-9530-a9de4b241b5b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:28 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-4759073a-379f-4208-9530-a9de4b241b5b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6adcf7b17de430a81e4f3adbb800919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dd9fcfea94665b9b9a97393f442f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:12:28 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-4759073a-379f-4208-9530-a9de4b241b5b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294" status: 200 len: 1710 microversion: 2.1 time: 0.397327 Nov 28 07:12:28 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 417/1237] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:12:27 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294 => generated 1710 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:12:31 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47958c9b-a2df-4beb-b3eb-27c616d1d976"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:31 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:31 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:31 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-cf83c8b3-57e0-4486-9f46-ab9d5c666228 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291856 Nov 28 07:12:31 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 412/1238] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:12:31 2023] POST /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:31 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:31 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 6c7bf4ad-7016-44a6-b27a-6dac06f10bda] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:31 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:31 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda could not be found. Nov 28 07:12:31 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance 6c7bf4ad-7016-44a6-b27a-6dac06f10bda could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:12:31 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e5c4acb3-5b67-4781-9218-6a28ff42814f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda" status: 404 len: 111 microversion: 2.1 time: 0.137279 Nov 28 07:12:31 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 410/1239] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:12:31 2023] GET /compute/v2.1/servers/6c7bf4ad-7016-44a6-b27a-6dac06f10bda => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:38 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4f1347-91b0-40ac-9190-889e27afba0b", "tag": "d7a4564b-b7fb-4f25-8afd-a74624159c8b"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:38 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] Creating event network-changed:d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance 5c4f1347-91b0-40ac-9190-889e27afba0b on user Nov 28 07:12:38 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-75ed15ce-193a-4d07-bc7c-f0a88d92be5d req-775effef-5dd2-4840-babf-e9ce1ded4908 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037055 Nov 28 07:12:38 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 413/1240] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:12:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:38 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:12:38 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d0065010-7b8a-4e1b-bdf9-388a7f02bc0f tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b" status: 204 len: 0 microversion: 2.1 time: 0.194524 Nov 28 07:12:38 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 418/1241] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:12:38 2023] DELETE /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:12:38 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-64d28729-c03d-48b5-a7ee-712cf0e7da0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:38 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-64d28729-c03d-48b5-a7ee-712cf0e7da0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64d28729-c03d-48b5-a7ee-712cf0e7da0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64d28729-c03d-48b5-a7ee-712cf0e7da0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64d28729-c03d-48b5-a7ee-712cf0e7da0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64d28729-c03d-48b5-a7ee-712cf0e7da0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64d28729-c03d-48b5-a7ee-712cf0e7da0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:38 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-64d28729-c03d-48b5-a7ee-712cf0e7da0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:39 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4f1347-91b0-40ac-9190-889e27afba0b", "name": "network-vif-unplugged", "status": "completed", "tag": "d7a4564b-b7fb-4f25-8afd-a74624159c8b"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:39 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] Creating event network-vif-unplugged:d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance 5c4f1347-91b0-40ac-9190-889e27afba0b on user Nov 28 07:12:39 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-d1f1ab5d-9c86-451d-8739-0bdd4eb34f22 req-bf0d2699-898f-4bd3-bdaa-3189057254f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038501 Nov 28 07:12:39 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 414/1242] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:12:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:39 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-64d28729-c03d-48b5-a7ee-712cf0e7da0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2139976b453e4bd2b8e83e551a0cc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecfa8e54acf42a8affd8686f500d6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:12:39 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-64d28729-c03d-48b5-a7ee-712cf0e7da0b tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b" status: 200 len: 1564 microversion: 2.1 time: 0.469038 Nov 28 07:12:39 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 411/1243] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:12:38 2023] GET /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b => generated 1564 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:12:40 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-c1897e1a-f8f8-46c6-8c1c-5b6dbeb2c90d req-1a62a107-5b19-4187-85ab-a6575cd15f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4f1347-91b0-40ac-9190-889e27afba0b", "name": "network-vif-deleted", "tag": "d7a4564b-b7fb-4f25-8afd-a74624159c8b"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c1897e1a-f8f8-46c6-8c1c-5b6dbeb2c90d req-1a62a107-5b19-4187-85ab-a6575cd15f88 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c1897e1a-f8f8-46c6-8c1c-5b6dbeb2c90d req-1a62a107-5b19-4187-85ab-a6575cd15f88 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:40 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-c1897e1a-f8f8-46c6-8c1c-5b6dbeb2c90d req-1a62a107-5b19-4187-85ab-a6575cd15f88 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-c1897e1a-f8f8-46c6-8c1c-5b6dbeb2c90d req-1a62a107-5b19-4187-85ab-a6575cd15f88 service nova] Creating event network-vif-deleted:d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance 5c4f1347-91b0-40ac-9190-889e27afba0b on user Nov 28 07:12:40 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-c1897e1a-f8f8-46c6-8c1c-5b6dbeb2c90d req-1a62a107-5b19-4187-85ab-a6575cd15f88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034451 Nov 28 07:12:40 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 419/1244] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:12:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:41 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4f1347-91b0-40ac-9190-889e27afba0b", "name": "network-vif-plugged", "status": "completed", "tag": "d7a4564b-b7fb-4f25-8afd-a74624159c8b"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:12:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:41 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] Creating event network-vif-plugged:d7a4564b-b7fb-4f25-8afd-a74624159c8b for instance 5c4f1347-91b0-40ac-9190-889e27afba0b on user Nov 28 07:12:41 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-5872fe86-d6ea-41f8-9556-58381998f1e9 req-c32cbacc-80b4-482a-a134-ec3ac4406e74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030603 Nov 28 07:12:41 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 415/1245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:12:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=10 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:54 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'services' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:12:54 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-4afd00a6-8477-4e71-8d91-774cd89362d7 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments/47958c9b-a2df-4beb-b3eb-27c616d1d976" status: 202 len: 0 microversion: 2.1 time: 0.171337 Nov 28 07:12:54 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 412/1246] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:12:54 2023] DELETE /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments/47958c9b-a2df-4beb-b3eb-27c616d1d976 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:12:54 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-02aeac27-49f7-4680-95fc-df7c8d01b44f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:54 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-02aeac27-49f7-4680-95fc-df7c8d01b44f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:54 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02aeac27-49f7-4680-95fc-df7c8d01b44f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02aeac27-49f7-4680-95fc-df7c8d01b44f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02aeac27-49f7-4680-95fc-df7c8d01b44f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02aeac27-49f7-4680-95fc-df7c8d01b44f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02aeac27-49f7-4680-95fc-df7c8d01b44f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:54 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-02aeac27-49f7-4680-95fc-df7c8d01b44f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:54 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-02aeac27-49f7-4680-95fc-df7c8d01b44f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055877 Nov 28 07:12:54 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 420/1247] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:12:54 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-291b345d-8d62-4372-9423-beb0ff82c214 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-291b345d-8d62-4372-9423-beb0ff82c214 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=10 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-291b345d-8d62-4372-9423-beb0ff82c214 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-291b345d-8d62-4372-9423-beb0ff82c214 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-291b345d-8d62-4372-9423-beb0ff82c214 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-291b345d-8d62-4372-9423-beb0ff82c214 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-291b345d-8d62-4372-9423-beb0ff82c214 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-291b345d-8d62-4372-9423-beb0ff82c214 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:12:59 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-291b345d-8d62-4372-9423-beb0ff82c214 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:12:59 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-291b345d-8d62-4372-9423-beb0ff82c214 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 200 len: 1534 microversion: 2.1 time: 0.236508 Nov 28 07:12:59 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 416/1248] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:12:59 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 1534 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: 5c4f1347-91b0-40ac-9190-889e27afba0b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance 5c4f1347-91b0-40ac-9190-889e27afba0b could not be found. Nov 28 07:13:29 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance 5c4f1347-91b0-40ac-9190-889e27afba0b could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:13:29 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-fe041185-5cc2-45ff-b4cf-6f8b3d3549b3 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b" status: 404 len: 111 microversion: 2.1 time: 0.049267 Nov 28 07:13:29 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 413/1249] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:13:29 2023] GET /compute/v2.1/servers/5c4f1347-91b0-40ac-9190-889e27afba0b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:13:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:13:30 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:13:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:30 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.wsgi [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance f112048f-4224-409f-bb75-63eb252c6097 could not be found. Nov 28 07:13:30 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance f112048f-4224-409f-bb75-63eb252c6097 could not be found. {{(pid=64872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:13:30 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-3ea36a76-431f-48ee-9b11-8ad3c1ab84af tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097" status: 404 len: 111 microversion: 2.1 time: 0.038793 Nov 28 07:13:30 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 421/1250] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:13:30 2023] DELETE /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] [instance: f112048f-4224-409f-bb75-63eb252c6097] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:30 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] HTTP exception thrown: Instance f112048f-4224-409f-bb75-63eb252c6097 could not be found. Nov 28 07:13:30 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Returning 404 to user: Instance f112048f-4224-409f-bb75-63eb252c6097 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:13:30 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0deb8d5f-e371-4fa5-b740-3214cf97171c tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097" status: 404 len: 111 microversion: 2.1 time: 0.056360 Nov 28 07:13:30 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 417/1251] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:13:30 2023] GET /compute/v2.1/servers/f112048f-4224-409f-bb75-63eb252c6097 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:13:33 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-de26435e-00ae-4568-a183-cc6affd788b0 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] Calling method '.version_select at 0x7f0b03507250>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:13:33 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-de26435e-00ae-4568-a183-cc6affd788b0 tempest-TestVolumeBootPattern-1541228194 tempest-TestVolumeBootPattern-1541228194-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1183583656" status: 202 len: 0 microversion: 2.1 time: 0.025968 Nov 28 07:13:33 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 414/1252] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Nov 28 07:13:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1183583656 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:13:44 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-b8785dfa-242c-49a1-a360-39d0d6ac0172 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:13:44 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-b8785dfa-242c-49a1-a360-39d0d6ac0172 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:13:44 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:44 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=8 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b8785dfa-242c-49a1-a360-39d0d6ac0172 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b8785dfa-242c-49a1-a360-39d0d6ac0172 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b8785dfa-242c-49a1-a360-39d0d6ac0172 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b8785dfa-242c-49a1-a360-39d0d6ac0172 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b8785dfa-242c-49a1-a360-39d0d6ac0172 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-b8785dfa-242c-49a1-a360-39d0d6ac0172 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:44 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-b8785dfa-242c-49a1-a360-39d0d6ac0172 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047363 Nov 28 07:13:44 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 422/1253] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:13:44 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 07:13:47 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "407b078b-36cb-4a8a-9a6e-d7064d103577"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:13:47 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:13:47 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:47 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:47 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:47 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-4445aeb5-6f29-4caf-b6fb-b4813098af4d tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260801 Nov 28 07:13:47 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 418/1254] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:13:47 2023] POST /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:57 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'services' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:13:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d36b1e4e-33ca-4c8d-b6fe-91b34419987c tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments/407b078b-36cb-4a8a-9a6e-d7064d103577" status: 202 len: 0 microversion: 2.1 time: 0.413474 Nov 28 07:13:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 415/1255] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:13:57 2023] DELETE /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments/407b078b-36cb-4a8a-9a6e-d7064d103577 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:13:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-f5bc3558-219c-4382-8976-0a44c824dfcc tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:13:57 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-f5bc3558-219c-4382-8976-0a44c824dfcc tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:13:57 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:57 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5bc3558-219c-4382-8976-0a44c824dfcc tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5bc3558-219c-4382-8976-0a44c824dfcc tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5bc3558-219c-4382-8976-0a44c824dfcc tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5bc3558-219c-4382-8976-0a44c824dfcc tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5bc3558-219c-4382-8976-0a44c824dfcc tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-f5bc3558-219c-4382-8976-0a44c824dfcc tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-f5bc3558-219c-4382-8976-0a44c824dfcc tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052999 Nov 28 07:13:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 423/1256] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:13:57 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:13:59 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:59 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:13:59 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-f6590125-8090-4247-8414-efdfaad2c4d0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:13:59 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-f6590125-8090-4247-8414-efdfaad2c4d0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:13:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f6590125-8090-4247-8414-efdfaad2c4d0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f6590125-8090-4247-8414-efdfaad2c4d0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f6590125-8090-4247-8414-efdfaad2c4d0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:13:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f6590125-8090-4247-8414-efdfaad2c4d0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:13:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f6590125-8090-4247-8414-efdfaad2c4d0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:13:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f6590125-8090-4247-8414-efdfaad2c4d0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:00 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-f6590125-8090-4247-8414-efdfaad2c4d0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:14:00 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-f6590125-8090-4247-8414-efdfaad2c4d0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 200 len: 1534 microversion: 2.1 time: 0.216432 Nov 28 07:14:00 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 419/1257] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:13:59 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 1534 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:14:00 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:14:00 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:14:00 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Searching by: {'deleted': False, 'project_id': '3af4e4870f934158819e183bbc7b499e'} {{(pid=64871) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 07:14:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:00 user devstack@n-api.service[64871]: DEBUG nova.compute.multi_cell_list [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 07:14:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e8344770-d44f-4b8a-a67c-7c3651c32d49 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.084108 Nov 28 07:14:00 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 416/1258] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 07:14:00 2023] GET /compute/v2.1/servers => generated 341 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:14:00 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-a93b3054-ba19-4b8e-b8ec-c0f375d1c85c tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:14:00 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-a93b3054-ba19-4b8e-b8ec-c0f375d1c85c tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:14:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a93b3054-ba19-4b8e-b8ec-c0f375d1c85c tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a93b3054-ba19-4b8e-b8ec-c0f375d1c85c tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a93b3054-ba19-4b8e-b8ec-c0f375d1c85c tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a93b3054-ba19-4b8e-b8ec-c0f375d1c85c tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a93b3054-ba19-4b8e-b8ec-c0f375d1c85c tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:00 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-a93b3054-ba19-4b8e-b8ec-c0f375d1c85c tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:00 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-a93b3054-ba19-4b8e-b8ec-c0f375d1c85c tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:14:00 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-a93b3054-ba19-4b8e-b8ec-c0f375d1c85c tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 200 len: 1534 microversion: 2.1 time: 0.205076 Nov 28 07:14:00 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 424/1259] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:14:00 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 1534 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:14:03 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5009fb21-cca6-4be0-ab41-0f287101a623"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:14:03 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:14:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:03 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:03 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-4b3487eb-23a0-4da4-9344-3218d846e104 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343695 Nov 28 07:14:03 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 420/1260] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:14:03 2023] POST /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-81ce3cfb-709a-4895-89dd-1de6194cfdd9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-81ce3cfb-709a-4895-89dd-1de6194cfdd9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81ce3cfb-709a-4895-89dd-1de6194cfdd9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81ce3cfb-709a-4895-89dd-1de6194cfdd9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81ce3cfb-709a-4895-89dd-1de6194cfdd9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81ce3cfb-709a-4895-89dd-1de6194cfdd9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81ce3cfb-709a-4895-89dd-1de6194cfdd9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-81ce3cfb-709a-4895-89dd-1de6194cfdd9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:13 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-81ce3cfb-709a-4895-89dd-1de6194cfdd9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:14:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-81ce3cfb-709a-4895-89dd-1de6194cfdd9 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 200 len: 1580 microversion: 2.1 time: 0.278946 Nov 28 07:14:13 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 417/1261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:14:13 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 1580 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:14:14 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:14 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=12 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:14:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] Creating event network-changed:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:14:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-9c043aee-6e6a-4838-91a3-c97a2f1a7061 req-fa067740-6c45-4eaf-beb8-a58ac10d66b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097107 Nov 28 07:14:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 425/1262] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:14:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:14:16 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:16 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c32e7384-553e-4ab6-8f03-b69b1aef23ad tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-958113378"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:14:16 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-c32e7384-553e-4ab6-8f03-b69b1aef23ad tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:14:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c32e7384-553e-4ab6-8f03-b69b1aef23ad tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c32e7384-553e-4ab6-8f03-b69b1aef23ad tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c32e7384-553e-4ab6-8f03-b69b1aef23ad tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c32e7384-553e-4ab6-8f03-b69b1aef23ad tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c32e7384-553e-4ab6-8f03-b69b1aef23ad tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c32e7384-553e-4ab6-8f03-b69b1aef23ad tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:16 user devstack@n-api.service[64873]: INFO nova.network.security_group_api [None req-c32e7384-553e-4ab6-8f03-b69b1aef23ad tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Adding security group 55ebf0a2-194c-4830-8ae4-b2ce6ed97737 to port 84587c86-6386-484a-9255-14e747fdaa68 Nov 28 07:14:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c32e7384-553e-4ab6-8f03-b69b1aef23ad tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/action" status: 202 len: 0 microversion: 2.1 time: 0.573351 Nov 28 07:14:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 421/1263] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 07:14:16 2023] POST /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:14:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-db7c1c84-b1ed-4e31-b17a-7a8db6eca18e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:14:17 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-db7c1c84-b1ed-4e31-b17a-7a8db6eca18e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:14:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-db7c1c84-b1ed-4e31-b17a-7a8db6eca18e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-db7c1c84-b1ed-4e31-b17a-7a8db6eca18e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-db7c1c84-b1ed-4e31-b17a-7a8db6eca18e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-db7c1c84-b1ed-4e31-b17a-7a8db6eca18e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-db7c1c84-b1ed-4e31-b17a-7a8db6eca18e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:17 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-db7c1c84-b1ed-4e31-b17a-7a8db6eca18e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] Creating event network-changed:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:14:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-527ece5c-a3ab-403e-af1a-2669cbac011e req-55aecc2c-6a7d-487b-849e-8170a2e9e1fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044887 Nov 28 07:14:17 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 418/1264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:14:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:14:17 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-db7c1c84-b1ed-4e31-b17a-7a8db6eca18e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:14:17 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-db7c1c84-b1ed-4e31-b17a-7a8db6eca18e tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 200 len: 1745 microversion: 2.1 time: 0.261524 Nov 28 07:14:17 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 426/1265] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:14:17 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 1745 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:14:17 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:14:17 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:14:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:17 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-a19f27b1-8a69-4ac4-8af3-2cd0c37ad95a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/action" status: 202 len: 0 microversion: 2.1 time: 0.093297 Nov 28 07:14:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 422/1266] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 07:14:17 2023] POST /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-0b7b42e2-c6cb-4f6d-9ef4-e37ae6cab857 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-0b7b42e2-c6cb-4f6d-9ef4-e37ae6cab857 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0b7b42e2-c6cb-4f6d-9ef4-e37ae6cab857 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0b7b42e2-c6cb-4f6d-9ef4-e37ae6cab857 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0b7b42e2-c6cb-4f6d-9ef4-e37ae6cab857 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0b7b42e2-c6cb-4f6d-9ef4-e37ae6cab857 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0b7b42e2-c6cb-4f6d-9ef4-e37ae6cab857 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0b7b42e2-c6cb-4f6d-9ef4-e37ae6cab857 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:17 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-0b7b42e2-c6cb-4f6d-9ef4-e37ae6cab857 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:14:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-0b7b42e2-c6cb-4f6d-9ef4-e37ae6cab857 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 200 len: 1737 microversion: 2.1 time: 0.222609 Nov 28 07:14:17 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 419/1267] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:14:17 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:14:20 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-unplugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:14:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:20 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] Creating event network-vif-unplugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:14:20 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-2b61f474-c5ce-4588-bbb9-b7beff105735 req-976e41bd-ea07-4418-b360-491b5643efee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032999 Nov 28 07:14:20 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 427/1268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:14:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:14:22 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-plugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}, {"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-plugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}, {"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-plugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}, {"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-unplugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}, {"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-plugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:14:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Creating event network-vif-plugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:14:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Creating event network-vif-plugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:14:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Creating event network-vif-plugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:14:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Creating event network-vif-unplugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:14:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] Creating event network-vif-plugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:14:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-91ea7085-bd0d-4fd9-9c1e-d4a02e0d447f req-f8dcc3f7-82f7-469f-8c57-f3570a4507d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032506 Nov 28 07:14:22 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 423/1269] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:14:22 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:14:24 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-plugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}, {"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-plugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:14:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:24 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Creating event network-vif-plugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:14:24 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] Creating event network-vif-plugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:14:24 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-56321030-5422-4471-b016-67488b6e13d4 req-3580c823-20e1-4ab7-b6ca-b1cbebf114c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032814 Nov 28 07:14:24 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 420/1270] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:14:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:14:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:47 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=10 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:47 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6e59942d-e211-477c-a1f6-f80046a2175f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:14:47 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-6e59942d-e211-477c-a1f6-f80046a2175f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:14:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6e59942d-e211-477c-a1f6-f80046a2175f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6e59942d-e211-477c-a1f6-f80046a2175f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6e59942d-e211-477c-a1f6-f80046a2175f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6e59942d-e211-477c-a1f6-f80046a2175f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6e59942d-e211-477c-a1f6-f80046a2175f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:47 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6e59942d-e211-477c-a1f6-f80046a2175f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:47 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-6e59942d-e211-477c-a1f6-f80046a2175f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051698 Nov 28 07:14:48 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 428/1271] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:14:47 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 07:14:50 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:50 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:14:50 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b7cc2c3-314a-427b-a874-d196a20f6370"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:14:50 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:14:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:14:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:14:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:14:51 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-45365787-f21f-49eb-9ddc-8ddd7fc91e69 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324335 Nov 28 07:14:51 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 424/1272] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:14:50 2023] POST /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=8 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=16 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:15:02 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'services' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:15:02 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-b202edca-dda0-40c2-884b-a7850a59988e tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments/6b7cc2c3-314a-427b-a874-d196a20f6370" status: 202 len: 0 microversion: 2.1 time: 0.194969 Nov 28 07:15:02 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 421/1273] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:15:02 2023] DELETE /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments/6b7cc2c3-314a-427b-a874-d196a20f6370 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:15:02 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-8109c02e-989d-4e6b-ab4d-1572e6047147 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:15:02 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-8109c02e-989d-4e6b-ab4d-1572e6047147 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:15:02 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:15:02 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:15:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8109c02e-989d-4e6b-ab4d-1572e6047147 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:15:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8109c02e-989d-4e6b-ab4d-1572e6047147 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:15:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8109c02e-989d-4e6b-ab4d-1572e6047147 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:15:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8109c02e-989d-4e6b-ab4d-1572e6047147 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:15:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8109c02e-989d-4e6b-ab4d-1572e6047147 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:15:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-8109c02e-989d-4e6b-ab4d-1572e6047147 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:15:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-8109c02e-989d-4e6b-ab4d-1572e6047147 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059570 Nov 28 07:15:02 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 429/1274] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:15:02 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:15:07 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:15:07 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:15:07 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-ee416b92-2c30-4546-a284-13fad27ab806 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:15:07 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-ee416b92-2c30-4546-a284-13fad27ab806 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:15:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ee416b92-2c30-4546-a284-13fad27ab806 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:15:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ee416b92-2c30-4546-a284-13fad27ab806 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:15:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ee416b92-2c30-4546-a284-13fad27ab806 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:15:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ee416b92-2c30-4546-a284-13fad27ab806 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:15:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ee416b92-2c30-4546-a284-13fad27ab806 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:15:07 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-ee416b92-2c30-4546-a284-13fad27ab806 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:15:08 user devstack@n-api.service[64873]: DEBUG nova.policy [None req-ee416b92-2c30-4546-a284-13fad27ab806 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64873) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:15:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-ee416b92-2c30-4546-a284-13fad27ab806 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 200 len: 1745 microversion: 2.1 time: 0.272040 Nov 28 07:15:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 425/1275] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:15:07 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 1745 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:15:52 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:15:52 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:15:52 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-3e5be618-0620-4838-8097-6aa3a8752ea5 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:15:52 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-3e5be618-0620-4838-8097-6aa3a8752ea5 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:15:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3e5be618-0620-4838-8097-6aa3a8752ea5 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:15:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3e5be618-0620-4838-8097-6aa3a8752ea5 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:15:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3e5be618-0620-4838-8097-6aa3a8752ea5 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:15:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3e5be618-0620-4838-8097-6aa3a8752ea5 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:15:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3e5be618-0620-4838-8097-6aa3a8752ea5 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:15:52 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-3e5be618-0620-4838-8097-6aa3a8752ea5 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:15:52 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-3e5be618-0620-4838-8097-6aa3a8752ea5 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.220996 Nov 28 07:15:52 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 422/1276] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:15:52 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 25 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 07:15:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c93fdd4-11ad-4039-a441-7d850eb4edd5"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:15:55 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:15:55 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:15:55 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:15:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:15:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:15:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:15:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:15:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:15:55 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:15:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-9b851ec5-c540-4b18-b469-6cc851180c57 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345386 Nov 28 07:15:55 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 430/1277] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:15:55 2023] POST /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:06 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lazy-loading 'services' on Instance uuid bdcf8d61-12d6-4698-9c25-907b4cdaf294 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:16:06 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-c209062f-59a4-4023-8ed3-da45b4698e63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments/3c93fdd4-11ad-4039-a441-7d850eb4edd5" status: 202 len: 0 microversion: 2.1 time: 0.168748 Nov 28 07:16:06 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 426/1278] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:16:06 2023] DELETE /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments/3c93fdd4-11ad-4039-a441-7d850eb4edd5 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:16:07 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-5469f8ed-2329-422a-9d76-761b39cf88a0 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:16:07 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-5469f8ed-2329-422a-9d76-761b39cf88a0 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:16:07 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:16:07 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:16:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5469f8ed-2329-422a-9d76-761b39cf88a0 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5469f8ed-2329-422a-9d76-761b39cf88a0 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5469f8ed-2329-422a-9d76-761b39cf88a0 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5469f8ed-2329-422a-9d76-761b39cf88a0 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5469f8ed-2329-422a-9d76-761b39cf88a0 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-5469f8ed-2329-422a-9d76-761b39cf88a0 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:07 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-5469f8ed-2329-422a-9d76-761b39cf88a0 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049555 Nov 28 07:16:07 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 423/1279] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:16:07 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:16:08 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:16:08 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:16:08 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-6fb45cda-bd61-4844-972e-10089ac2f1be tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-958113378"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:16:08 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-6fb45cda-bd61-4844-972e-10089ac2f1be tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:16:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6fb45cda-bd61-4844-972e-10089ac2f1be tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6fb45cda-bd61-4844-972e-10089ac2f1be tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6fb45cda-bd61-4844-972e-10089ac2f1be tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6fb45cda-bd61-4844-972e-10089ac2f1be tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6fb45cda-bd61-4844-972e-10089ac2f1be tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:08 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-6fb45cda-bd61-4844-972e-10089ac2f1be tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:08 user devstack@n-api.service[64872]: INFO nova.network.security_group_api [None req-6fb45cda-bd61-4844-972e-10089ac2f1be tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Removing security group 55ebf0a2-194c-4830-8ae4-b2ce6ed97737 from port 84587c86-6386-484a-9255-14e747fdaa68 Nov 28 07:16:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-6fb45cda-bd61-4844-972e-10089ac2f1be tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/action" status: 202 len: 0 microversion: 2.1 time: 0.670859 Nov 28 07:16:09 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 431/1280] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 07:16:08 2023] POST /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:16:09 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:16:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:09 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] Creating event network-changed:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:16:09 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-12e0a2d0-cc36-4833-9936-56c41ae23cad req-75aa23d7-ada2-4dc8-8aae-689500c8f717 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087301 Nov 28 07:16:09 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 427/1281] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:16:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:16:10 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:16:10 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:16:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:10 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:16:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:10 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] Creating event network-changed:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:16:10 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-0cda1c71-cb10-4635-9aa1-9c5eb3666ba2 req-93906c57-506c-4927-9858-51f2809ac06f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119082 Nov 28 07:16:10 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lazy-loading 'services' on Instance uuid 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:16:10 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 432/1282] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:16:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:16:10 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-f67fff04-afa7-4a9e-96b2-3990d590dd7b tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/os-volume_attachments/5009fb21-cca6-4be0-ab41-0f287101a623" status: 202 len: 0 microversion: 2.1 time: 0.206541 Nov 28 07:16:10 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 424/1283] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:16:10 2023] DELETE /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/os-volume_attachments/5009fb21-cca6-4be0-ab41-0f287101a623 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:16:10 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-f4193ac4-96d5-4ff5-baf3-1ad89fc815f5 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:16:10 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-f4193ac4-96d5-4ff5-baf3-1ad89fc815f5 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:16:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f4193ac4-96d5-4ff5-baf3-1ad89fc815f5 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f4193ac4-96d5-4ff5-baf3-1ad89fc815f5 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f4193ac4-96d5-4ff5-baf3-1ad89fc815f5 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f4193ac4-96d5-4ff5-baf3-1ad89fc815f5 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f4193ac4-96d5-4ff5-baf3-1ad89fc815f5 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:10 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-f4193ac4-96d5-4ff5-baf3-1ad89fc815f5 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:10 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-f4193ac4-96d5-4ff5-baf3-1ad89fc815f5 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046164 Nov 28 07:16:10 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 428/1284] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:16:10 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:16:57 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:16:57 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:16:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-12b8db94-846b-47a5-96a6-6cde70f4462b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:16:57 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-12b8db94-846b-47a5-96a6-6cde70f4462b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:16:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-12b8db94-846b-47a5-96a6-6cde70f4462b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-12b8db94-846b-47a5-96a6-6cde70f4462b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-12b8db94-846b-47a5-96a6-6cde70f4462b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-12b8db94-846b-47a5-96a6-6cde70f4462b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:16:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-12b8db94-846b-47a5-96a6-6cde70f4462b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:16:57 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-12b8db94-846b-47a5-96a6-6cde70f4462b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:16:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-12b8db94-846b-47a5-96a6-6cde70f4462b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067827 Nov 28 07:16:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 433/1285] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:16:57 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 07:17:00 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=4 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:00 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:00 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-396aee90-0a51-439a-a952-fcb0c3927653 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:17:00 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-396aee90-0a51-439a-a952-fcb0c3927653 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:17:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-396aee90-0a51-439a-a952-fcb0c3927653 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-396aee90-0a51-439a-a952-fcb0c3927653 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-396aee90-0a51-439a-a952-fcb0c3927653 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-396aee90-0a51-439a-a952-fcb0c3927653 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-396aee90-0a51-439a-a952-fcb0c3927653 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:00 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-396aee90-0a51-439a-a952-fcb0c3927653 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:00 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-396aee90-0a51-439a-a952-fcb0c3927653 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065016 Nov 28 07:17:00 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 425/1286] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:17:00 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 07:17:00 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:17:00 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:17:00 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:00 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:00 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] HTTP exception thrown: Instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b is not attached to volume 5009fb21-cca6-4be0-ab41-0f287101a623 Nov 28 07:17:01 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Returning 404 to user: Instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b is not attached to volume 5009fb21-cca6-4be0-ab41-0f287101a623 {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:17:01 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-8c1ef539-463c-419a-884a-b0379bd4a87a tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/os-volume_attachments/5009fb21-cca6-4be0-ab41-0f287101a623" status: 404 len: 154 microversion: 2.1 time: 0.109796 Nov 28 07:17:01 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 429/1287] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:17:00 2023] DELETE /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b/os-volume_attachments/5009fb21-cca6-4be0-ab41-0f287101a623 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:07 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Going to try to terminate instance {{(pid=64872) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:17:07 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-46f83233-3137-4d7a-99c6-21877b8608fd tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 204 len: 0 microversion: 2.1 time: 0.120492 Nov 28 07:17:07 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 434/1288] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:17:07 2023] DELETE /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:17:07 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-db333094-cf62-499c-8e36-4cbadf1759d3 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:17:07 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-db333094-cf62-499c-8e36-4cbadf1759d3 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:17:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-db333094-cf62-499c-8e36-4cbadf1759d3 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-db333094-cf62-499c-8e36-4cbadf1759d3 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-db333094-cf62-499c-8e36-4cbadf1759d3 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-db333094-cf62-499c-8e36-4cbadf1759d3 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-db333094-cf62-499c-8e36-4cbadf1759d3 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:07 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-db333094-cf62-499c-8e36-4cbadf1759d3 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:07 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-db333094-cf62-499c-8e36-4cbadf1759d3 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41da15820f7d43dfad1503c8d7355e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4e4870f934158819e183bbc7b499e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:17:07 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-db333094-cf62-499c-8e36-4cbadf1759d3 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 200 len: 1540 microversion: 2.1 time: 0.252549 Nov 28 07:17:07 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 426/1289] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:17:07 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 1540 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:17:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-unplugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:17:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] Creating event network-vif-unplugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:17:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-0d82f030-1b60-4c93-baf7-4f205bf142ab req-a231559f-a791-45c1-b3ce-8b59217ba3ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046564 Nov 28 07:17:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 430/1290] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:17:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:17:09 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-6b898901-c305-4344-a284-f7f460126e05 req-f99dd34f-fe62-4300-bb5c-cea346ee27e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-deleted", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:17:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6b898901-c305-4344-a284-f7f460126e05 req-f99dd34f-fe62-4300-bb5c-cea346ee27e4 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6b898901-c305-4344-a284-f7f460126e05 req-f99dd34f-fe62-4300-bb5c-cea346ee27e4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:09 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-6b898901-c305-4344-a284-f7f460126e05 req-f99dd34f-fe62-4300-bb5c-cea346ee27e4 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-6b898901-c305-4344-a284-f7f460126e05 req-f99dd34f-fe62-4300-bb5c-cea346ee27e4 service nova] Creating event network-vif-deleted:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:17:09 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-6b898901-c305-4344-a284-f7f460126e05 req-f99dd34f-fe62-4300-bb5c-cea346ee27e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035743 Nov 28 07:17:09 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 435/1291] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:17:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:17:10 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b", "name": "network-vif-plugged", "status": "completed", "tag": "84587c86-6386-484a-9255-14e747fdaa68"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:17:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:10 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] Creating event network-vif-plugged:84587c86-6386-484a-9255-14e747fdaa68 for instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b on user Nov 28 07:17:10 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-79967a97-84fc-45fe-91cc-63376f83a35e req-244a1c3a-8097-4011-812a-87be889f3367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037692 Nov 28 07:17:10 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 427/1292] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:17:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:17:22 user devstack@n-api.service[64873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 07:17:22 user devstack@n-api.service[64873]: Tue Nov 28 07:17:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294 (ip 10.0.0.210) !!! Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=8 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:22 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Going to try to terminate instance {{(pid=64873) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:17:22 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-e8415182-17e8-406f-b51b-f987d0408f63 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294" status: 204 len: 0 microversion: 2.1 time: 0.126780 Nov 28 07:17:22 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 431/1293] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:17:22 2023] DELETE /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-acbae4e4-f576-4245-8080-5640413ac10b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-acbae4e4-f576-4245-8080-5640413ac10b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-acbae4e4-f576-4245-8080-5640413ac10b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-acbae4e4-f576-4245-8080-5640413ac10b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-acbae4e4-f576-4245-8080-5640413ac10b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-acbae4e4-f576-4245-8080-5640413ac10b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-acbae4e4-f576-4245-8080-5640413ac10b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-acbae4e4-f576-4245-8080-5640413ac10b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:22 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:22 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=14 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:22 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdcf8d61-12d6-4698-9c25-907b4cdaf294", "name": "network-vif-unplugged", "status": "completed", "tag": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:17:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:22 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:22 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] Creating event network-vif-unplugged:ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 on user Nov 28 07:17:22 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-1dbe0933-88fb-4ad5-b138-d71b8a78e7f9 req-b32f9a8f-dae8-42f8-956d-97227c3e955c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052031 Nov 28 07:17:22 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 428/1294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:17:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:17:22 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-acbae4e4-f576-4245-8080-5640413ac10b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6adcf7b17de430a81e4f3adbb800919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dd9fcfea94665b9b9a97393f442f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:17:22 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-acbae4e4-f576-4245-8080-5640413ac10b tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294" status: 200 len: 1716 microversion: 2.1 time: 0.293548 Nov 28 07:17:22 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 436/1295] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:17:22 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294 => generated 1716 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:17:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdcf8d61-12d6-4698-9c25-907b4cdaf294", "name": "network-vif-plugged", "status": "completed", "tag": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20"}, {"server_uuid": "bdcf8d61-12d6-4698-9c25-907b4cdaf294", "name": "network-vif-deleted", "tag": "ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:17:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] Creating event network-vif-plugged:ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 on user Nov 28 07:17:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] Creating event network-vif-deleted:ecf75c9d-e8a5-4100-83b9-e6d05ebc2f20 for instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 on user Nov 28 07:17:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-dca80840-1be6-47a9-bdb8-9f59f957df4c req-833174cf-ce36-46ed-80b9-3187f5ad58ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032349 Nov 28 07:17:24 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 432/1296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:17:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] [instance: 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:17:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.wsgi [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] HTTP exception thrown: Instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b could not be found. Nov 28 07:17:57 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Returning 404 to user: Instance 0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b could not be found. {{(pid=64871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:17:57 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-706c7766-c1c2-4b1e-90c9-5a3208a2f2a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b" status: 404 len: 111 microversion: 2.1 time: 0.035568 Nov 28 07:17:57 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 429/1297] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:17:57 2023] GET /compute/v2.1/servers/0c8b7730-09de-4cb1-b9e4-c2ab85e5e12b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:17:57 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-03c15d84-68d0-4496-8040-0a043799f7a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] Calling method '.version_select at 0x7f0b034c6dd0>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:17:57 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:57 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:17:57 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-03c15d84-68d0-4496-8040-0a043799f7a0 tempest-TestMinimumBasicScenario-1726429113 tempest-TestMinimumBasicScenario-1726429113-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-969944734" status: 202 len: 0 microversion: 2.1 time: 0.031787 Nov 28 07:17:57 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 437/1298] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Nov 28 07:17:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-969944734 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] [instance: bdcf8d61-12d6-4698-9c25-907b4cdaf294] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:18:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] HTTP exception thrown: Instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 could not be found. Nov 28 07:18:12 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Returning 404 to user: Instance bdcf8d61-12d6-4698-9c25-907b4cdaf294 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:18:12 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-72955d54-b807-49e6-8528-b32f9e26cd3f tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294" status: 404 len: 111 microversion: 2.1 time: 0.039423 Nov 28 07:18:12 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 433/1299] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:18:12 2023] GET /compute/v2.1/servers/bdcf8d61-12d6-4698-9c25-907b4cdaf294 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:18:13 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-d61f283d-35fa-4dbc-98f4-2ebe577dde97 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] Calling method '.version_select at 0x7f0b035a2c20>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:18:13 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:18:13 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:18:13 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-d61f283d-35fa-4dbc-98f4-2ebe577dde97 tempest-SnapshotDataIntegrityTests-29578551 tempest-SnapshotDataIntegrityTests-29578551-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050103458" status: 202 len: 0 microversion: 2.1 time: 0.029469 Nov 28 07:18:13 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 430/1300] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 07:18:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050103458 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:18:55 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:18:55 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e917fe9d-1281-4331-8918-e727b4c32be1 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Action: 'create', calling method: .version_select at 0x7f0b034c6cb0>, body: {"keypair": {"name": "tempest-keypair-1169283717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXbrnHRsFwacr5v9YfBpNJSMg5lP+utOEuXsZDViJUnDbMoD4s74lS9jPlZbwoHMZuBw2gwIA270MFTr/cSX68hUHulrGPbTO07K0Uv7Vfc63lNfhD0c44NP/vOPByAag=="}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:18:55 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-e917fe9d-1281-4331-8918-e727b4c32be1 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Getting quotas for project 68236ceaeff245b795f960f8c76dc912. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:18:55 user devstack@n-api.service[64872]: DEBUG nova.quota [None req-e917fe9d-1281-4331-8918-e727b4c32be1 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Getting quotas for user 6bc8687cad2e4adb888c8f889e915ac3 and project 68236ceaeff245b795f960f8c76dc912. Resources: {'key_pairs'} {{(pid=64872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:18:55 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e917fe9d-1281-4331-8918-e727b4c32be1 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.350602 Nov 28 07:18:55 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 438/1301] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 07:18:55 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:18:58 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-263195453", "imageRef": "f62a76e5-f00c-416b-84d0-db9b754396ab", "flavorRef": "1", "key_name": "tempest-keypair-1169283717", "security_groups": [{"name": "tempest-secgroup-smoke-2136722050"}, {"name": "tempest-securitygroup--13736173"}], "networks": [{"uuid": "2b4954c2-f2fd-4268-a13c-91e6d6532e82"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:18:58 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:18:58 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:18:58 user devstack@n-api.service[64873]: DEBUG nova.network.neutron [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] validate_networks() for [('2b4954c2-f2fd-4268-a13c-91e6d6532e82', None, None, None, None, None)] {{(pid=64873) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Flavor limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Image limits 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Flavor pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Image pref 0:0:0 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG nova.virt.hardware [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Getting quotas for project 68236ceaeff245b795f960f8c76dc912. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG nova.quota [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Getting quotas for user 6bc8687cad2e4adb888c8f889e915ac3 and project 68236ceaeff245b795f960f8c76dc912. Resources: {'instances', 'cores', 'ram'} {{(pid=64873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Going to run 1 instances... {{(pid=64873) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 07:18:59 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f62a76e5-f00c-416b-84d0-db9b754396ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 07:18:59 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-6907b265-923e-49c1-b879-5f496beea739 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 449 microversion: 2.1 time: 0.717159 Nov 28 07:18:59 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 434/1302] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 07:18:58 2023] POST /compute/v2.1/servers => generated 449 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 07:18:59 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:18:59 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-648c4f75-c41f-4bf4-a0a5-54822610ad4c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:18:59 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-648c4f75-c41f-4bf4-a0a5-54822610ad4c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:18:59 user devstack@n-api.service[64871]: DEBUG nova.policy [None req-648c4f75-c41f-4bf4-a0a5-54822610ad4c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc8687cad2e4adb888c8f889e915ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68236ceaeff245b795f960f8c76dc912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64871) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:18:59 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-648c4f75-c41f-4bf4-a0a5-54822610ad4c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02" status: 200 len: 1235 microversion: 2.1 time: 0.255131 Nov 28 07:18:59 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 431/1303] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:18:59 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02 => generated 1235 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:19:02 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539b0e5c-0f78-46aa-96fb-4b9953d3cd02", "tag": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:19:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:19:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:19:02 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:19:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] Creating event network-changed:3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 on user Nov 28 07:19:02 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-72e88437-9c33-4edd-a0ff-d8c4351a2afc req-0eb7a6ef-5039-44e0-b353-3ad475abf9d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035980 Nov 28 07:19:02 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 439/1304] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:19:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:19:04 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539b0e5c-0f78-46aa-96fb-4b9953d3cd02", "name": "network-vif-plugged", "status": "completed", "tag": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:19:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:19:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:19:04 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:19:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] Creating event network-vif-plugged:3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 on user Nov 28 07:19:04 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-c7ea0c37-6c96-4ffb-bdbb-5a0f0239eafc req-6159c291-2922-48ee-a2ad-b3ea75c300b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043013 Nov 28 07:19:04 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 435/1305] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:19:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:19:06 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539b0e5c-0f78-46aa-96fb-4b9953d3cd02", "name": "network-vif-plugged", "status": "completed", "tag": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:19:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:19:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:19:06 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:19:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] Creating event network-vif-plugged:3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 on user Nov 28 07:19:06 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-dc02b567-7e77-4d68-96cf-13d26b7d7cd9 req-2e5ea55d-e3a4-4ffc-b036-4e421e4daed3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037406 Nov 28 07:19:06 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 432/1306] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:19:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-d70b0ccb-9c64-486e-a03f-4d5b362a0023 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-d70b0ccb-9c64-486e-a03f-4d5b362a0023 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell0:SELECT=4 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d70b0ccb-9c64-486e-a03f-4d5b362a0023 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d70b0ccb-9c64-486e-a03f-4d5b362a0023 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d70b0ccb-9c64-486e-a03f-4d5b362a0023 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d70b0ccb-9c64-486e-a03f-4d5b362a0023 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d70b0ccb-9c64-486e-a03f-4d5b362a0023 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:19:49 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-d70b0ccb-9c64-486e-a03f-4d5b362a0023 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:19:50 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-d70b0ccb-9c64-486e-a03f-4d5b362a0023 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc8687cad2e4adb888c8f889e915ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68236ceaeff245b795f960f8c76dc912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:19:50 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-d70b0ccb-9c64-486e-a03f-4d5b362a0023 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02" status: 200 len: 1592 microversion: 2.1 time: 0.300988 Nov 28 07:19:50 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 440/1307] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:19:49 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02 => generated 1592 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell0:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:20:50 user devstack@n-api.service[64873]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b0e29a0-7f99-4a46-88ca-11e32bf8df80] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-b9cbbe02-6b8a-42d1-9f61-3edfcdd323f6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-b9cbbe02-6b8a-42d1-9f61-3edfcdd323f6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b9cbbe02-6b8a-42d1-9f61-3edfcdd323f6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b9cbbe02-6b8a-42d1-9f61-3edfcdd323f6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b9cbbe02-6b8a-42d1-9f61-3edfcdd323f6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b9cbbe02-6b8a-42d1-9f61-3edfcdd323f6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b9cbbe02-6b8a-42d1-9f61-3edfcdd323f6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:20:50 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-b9cbbe02-6b8a-42d1-9f61-3edfcdd323f6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:20:50 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-b9cbbe02-6b8a-42d1-9f61-3edfcdd323f6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.367435 Nov 28 07:20:50 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 436/1308] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 07:20:50 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-interface => generated 283 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:20:51 user devstack@n-api.service[64871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 07:20:51 user devstack@n-api.service[64871]: Tue Nov 28 07:20:51 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 07:20:51 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell0:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:20:51 user devstack@n-api.service[64871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1ae8178a-5938-4e4b-aad4-0d28d1beb089] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 07:20:51 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:20:51 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:20:51 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539b0e5c-0f78-46aa-96fb-4b9953d3cd02", "tag": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:20:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:20:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:20:51 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:20:51 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] Creating event network-changed:3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 on user Nov 28 07:20:51 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-4dfacaa4-259e-4725-b422-e65cb8005cb2 req-d224be9f-58ce-48b7-8417-be608b55c65d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049179 Nov 28 07:20:51 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 433/1309] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:20:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3e65f9b5-08f2-4a9d-9e03-a7e498172a9f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-3e65f9b5-08f2-4a9d-9e03-a7e498172a9f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3e65f9b5-08f2-4a9d-9e03-a7e498172a9f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3e65f9b5-08f2-4a9d-9e03-a7e498172a9f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3e65f9b5-08f2-4a9d-9e03-a7e498172a9f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3e65f9b5-08f2-4a9d-9e03-a7e498172a9f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3e65f9b5-08f2-4a9d-9e03-a7e498172a9f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3e65f9b5-08f2-4a9d-9e03-a7e498172a9f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:20:52 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-3e65f9b5-08f2-4a9d-9e03-a7e498172a9f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc8687cad2e4adb888c8f889e915ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68236ceaeff245b795f960f8c76dc912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:20:52 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-3e65f9b5-08f2-4a9d-9e03-a7e498172a9f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02" status: 200 len: 1711 microversion: 2.1 time: 0.269267 Nov 28 07:20:52 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 441/1310] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:20:52 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02 => generated 1711 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:20:55 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "493fccde-4838-4d33-bc81-d922f1149444"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:20:55 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:20:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:20:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:20:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:20:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:20:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:20:55 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:20:55 user devstack@n-api.service[64873]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b0e29a0-7f99-4a46-88ca-11e32bf8df80] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 48512. Nov 28 07:20:55 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-4c9a229d-d789-4de5-bbaf-f4b4831f5924 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "POST /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272434 Nov 28 07:20:55 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 437/1311] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:20:55 2023] POST /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:21:17 user devstack@n-api.service[64871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 28 07:21:17 user devstack@n-api.service[64871]: Tue Nov 28 07:21:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/493fccde-4838-4d33-bc81-d922f1149444 (ip 10.0.0.210) !!! Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:21:17 user devstack@n-api.service[64871]: INFO oslo.messaging._drivers.impl_rabbit [-] [1ae8178a-5938-4e4b-aad4-0d28d1beb089] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47286. Nov 28 07:21:17 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'services' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:21:17 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-0a70d335-5a07-41ab-a1b9-b760cc0d9cd8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/493fccde-4838-4d33-bc81-d922f1149444" status: 202 len: 0 microversion: 2.1 time: 0.298589 Nov 28 07:21:17 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 434/1312] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:21:17 2023] DELETE /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/493fccde-4838-4d33-bc81-d922f1149444 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:21:17 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-cf44ee16-5680-4e4e-819c-02d4244e1392 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:21:17 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-cf44ee16-5680-4e4e-819c-02d4244e1392 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:21:17 user devstack@n-api.service[64872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9d44581-a3cd-4b07-a82a-7479800c7fa3] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 07:21:17 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:21:17 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:21:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cf44ee16-5680-4e4e-819c-02d4244e1392 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:21:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cf44ee16-5680-4e4e-819c-02d4244e1392 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:21:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cf44ee16-5680-4e4e-819c-02d4244e1392 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:21:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cf44ee16-5680-4e4e-819c-02d4244e1392 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:21:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cf44ee16-5680-4e4e-819c-02d4244e1392 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:21:18 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-cf44ee16-5680-4e4e-819c-02d4244e1392 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:21:18 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-cf44ee16-5680-4e4e-819c-02d4244e1392 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047053 Nov 28 07:21:18 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 442/1313] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:21:17 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:22:08 user devstack@n-api.service[64873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 07:22:08 user devstack@n-api.service[64873]: Tue Nov 28 07:22:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 07:22:08 user devstack@n-api.service[64873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 07:22:08 user devstack@n-api.service[64873]: Tue Nov 28 07:22:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 07:22:08 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=4 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:22:08 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:22:08 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-cd2acaa1-9ff8-4bb2-a291-b90b58065d7a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:22:08 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-cd2acaa1-9ff8-4bb2-a291-b90b58065d7a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:22:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd2acaa1-9ff8-4bb2-a291-b90b58065d7a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:22:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd2acaa1-9ff8-4bb2-a291-b90b58065d7a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:22:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd2acaa1-9ff8-4bb2-a291-b90b58065d7a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:22:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd2acaa1-9ff8-4bb2-a291-b90b58065d7a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:22:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd2acaa1-9ff8-4bb2-a291-b90b58065d7a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:22:08 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-cd2acaa1-9ff8-4bb2-a291-b90b58065d7a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:22:08 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-cd2acaa1-9ff8-4bb2-a291-b90b58065d7a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056931 Nov 28 07:22:08 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 438/1314] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:22:08 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 07:22:10 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:22:10 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:22:10 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04d97406-282f-4111-9893-c6ac03d29a4e"}} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:22:10 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:22:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:22:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:22:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:22:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:22:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:22:10 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:22:11 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-c9b8cd23-bf33-410b-a0d0-34d83c111d2a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "POST /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281975 Nov 28 07:22:11 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 435/1315] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:22:10 2023] POST /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:22:21 user devstack@n-api.service[64872]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9d44581-a3cd-4b07-a82a-7479800c7fa3] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 42578. Nov 28 07:22:21 user devstack@n-api.service[64872]: DEBUG nova.objects.instance [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'services' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=64872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:22:21 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-3c7a0e8d-ded4-4330-9f15-0cb33502bad6 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/04d97406-282f-4111-9893-c6ac03d29a4e" status: 202 len: 0 microversion: 2.1 time: 0.428826 Nov 28 07:22:21 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 443/1316] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:22:21 2023] DELETE /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/04d97406-282f-4111-9893-c6ac03d29a4e => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 28 07:22:21 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-01243071-8c28-4044-91b4-4d32d217de7d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:22:21 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-01243071-8c28-4044-91b4-4d32d217de7d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:22:21 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:22:21 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:22:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-01243071-8c28-4044-91b4-4d32d217de7d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:22:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-01243071-8c28-4044-91b4-4d32d217de7d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:22:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-01243071-8c28-4044-91b4-4d32d217de7d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:22:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-01243071-8c28-4044-91b4-4d32d217de7d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:22:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-01243071-8c28-4044-91b4-4d32d217de7d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:22:21 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-01243071-8c28-4044-91b4-4d32d217de7d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:22:21 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-01243071-8c28-4044-91b4-4d32d217de7d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049600 Nov 28 07:22:21 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 439/1317] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:22:21 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:23:11 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:23:11 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:23:11 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-afae9fae-fe05-42f1-8b70-e5bc8e69bb05 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:23:11 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-afae9fae-fe05-42f1-8b70-e5bc8e69bb05 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:23:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-afae9fae-fe05-42f1-8b70-e5bc8e69bb05 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:23:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-afae9fae-fe05-42f1-8b70-e5bc8e69bb05 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:23:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-afae9fae-fe05-42f1-8b70-e5bc8e69bb05 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:23:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-afae9fae-fe05-42f1-8b70-e5bc8e69bb05 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:23:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-afae9fae-fe05-42f1-8b70-e5bc8e69bb05 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:23:11 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-afae9fae-fe05-42f1-8b70-e5bc8e69bb05 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:23:11 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-afae9fae-fe05-42f1-8b70-e5bc8e69bb05 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060837 Nov 28 07:23:11 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 436/1318] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:23:11 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 07:23:14 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:23:14 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:23:14 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6947f7d8-d2fb-4309-90d7-4d03367aa3f9"}} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:23:14 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:23:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:23:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:23:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:23:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:23:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:23:14 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:23:14 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-2f781b62-c8f6-48f2-9cca-f93385cf89e4 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "POST /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286190 Nov 28 07:23:14 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 444/1319] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:23:14 2023] POST /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:23:24 user devstack@n-api.service[64873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 07:23:24 user devstack@n-api.service[64873]: Tue Nov 28 07:23:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/6947f7d8-d2fb-4309-90d7-4d03367aa3f9 (ip 10.0.0.210) !!! Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:23:24 user devstack@n-api.service[64873]: DEBUG nova.objects.instance [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'services' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=64873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:23:24 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-5898248b-d3fc-4abb-9907-0a1b3d59c70c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/6947f7d8-d2fb-4309-90d7-4d03367aa3f9" status: 202 len: 0 microversion: 2.1 time: 0.192805 Nov 28 07:23:24 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 440/1320] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:23:24 2023] DELETE /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/6947f7d8-d2fb-4309-90d7-4d03367aa3f9 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:23:24 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-bc3abf40-9a6c-4bd1-b13a-b5bedc21def8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:23:24 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-bc3abf40-9a6c-4bd1-b13a-b5bedc21def8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:23:24 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:23:24 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:23:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bc3abf40-9a6c-4bd1-b13a-b5bedc21def8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:23:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bc3abf40-9a6c-4bd1-b13a-b5bedc21def8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:23:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bc3abf40-9a6c-4bd1-b13a-b5bedc21def8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:23:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bc3abf40-9a6c-4bd1-b13a-b5bedc21def8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:23:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bc3abf40-9a6c-4bd1-b13a-b5bedc21def8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:23:24 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-bc3abf40-9a6c-4bd1-b13a-b5bedc21def8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:23:24 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-bc3abf40-9a6c-4bd1-b13a-b5bedc21def8 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048008 Nov 28 07:23:24 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 437/1321] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:23:24 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:24:14 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:24:14 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:24:15 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-77bfe73c-12e8-471e-aab4-9e955ecffb6f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:24:15 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-77bfe73c-12e8-471e-aab4-9e955ecffb6f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:24:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-77bfe73c-12e8-471e-aab4-9e955ecffb6f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:24:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-77bfe73c-12e8-471e-aab4-9e955ecffb6f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:24:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-77bfe73c-12e8-471e-aab4-9e955ecffb6f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:24:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-77bfe73c-12e8-471e-aab4-9e955ecffb6f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:24:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-77bfe73c-12e8-471e-aab4-9e955ecffb6f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:24:15 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-77bfe73c-12e8-471e-aab4-9e955ecffb6f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:24:15 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-77bfe73c-12e8-471e-aab4-9e955ecffb6f tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168030 Nov 28 07:24:15 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 445/1322] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:24:14 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 25 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 07:24:16 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:24:16 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:24:16 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cff13b8-7e4d-41a1-b80d-a6500cccfdd9"}} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:24:16 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:24:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:24:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:24:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:24:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:24:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:24:16 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:24:17 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-8b7a80ac-605b-4145-a372-8d088c9aabb5 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "POST /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417257 Nov 28 07:24:17 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 441/1323] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 07:24:16 2023] POST /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:24:28 user devstack@n-api.service[64871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 07:24:28 user devstack@n-api.service[64871]: Tue Nov 28 07:24:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 (ip 10.0.0.210) !!! Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=6 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:24:28 user devstack@n-api.service[64871]: DEBUG nova.objects.instance [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lazy-loading 'services' on Instance uuid 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 {{(pid=64871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 07:24:28 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-398df985-3156-4438-ac71-24f2b6d4b7e7 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/1cff13b8-7e4d-41a1-b80d-a6500cccfdd9" status: 202 len: 0 microversion: 2.1 time: 0.238768 Nov 28 07:24:28 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 438/1324] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 07:24:28 2023] DELETE /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments/1cff13b8-7e4d-41a1-b80d-a6500cccfdd9 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 07:24:28 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-019b28d8-d594-47db-b09e-5e9c510b875c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:24:28 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-019b28d8-d594-47db-b09e-5e9c510b875c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:24:28 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:24:28 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:24:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-019b28d8-d594-47db-b09e-5e9c510b875c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:24:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-019b28d8-d594-47db-b09e-5e9c510b875c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:24:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-019b28d8-d594-47db-b09e-5e9c510b875c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:24:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-019b28d8-d594-47db-b09e-5e9c510b875c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:24:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-019b28d8-d594-47db-b09e-5e9c510b875c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:24:28 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-019b28d8-d594-47db-b09e-5e9c510b875c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:24:28 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-019b28d8-d594-47db-b09e-5e9c510b875c tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049774 Nov 28 07:24:28 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 446/1325] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:24:28 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:25:18 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:25:18 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:25:18 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-78071367-4aa8-4122-a7a5-8ad46e01e656 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:25:18 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-78071367-4aa8-4122-a7a5-8ad46e01e656 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:25:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78071367-4aa8-4122-a7a5-8ad46e01e656 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:25:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78071367-4aa8-4122-a7a5-8ad46e01e656 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:25:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78071367-4aa8-4122-a7a5-8ad46e01e656 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:25:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78071367-4aa8-4122-a7a5-8ad46e01e656 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:25:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78071367-4aa8-4122-a7a5-8ad46e01e656 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:25:18 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-78071367-4aa8-4122-a7a5-8ad46e01e656 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:25:18 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-78071367-4aa8-4122-a7a5-8ad46e01e656 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048875 Nov 28 07:25:18 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 442/1326] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 07:25:18 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 07:25:43 user devstack@n-api.service[64871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1ae8178a-5938-4e4b-aad4-0d28d1beb089] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=2 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64871) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:25:43 user devstack@n-api.service[64871]: DEBUG nova.compute.api [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Going to try to terminate instance {{(pid=64871) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 07:25:44 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-baeffc86-9e0e-4f80-9850-355f547cbddc tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02" status: 204 len: 0 microversion: 2.1 time: 0.156495 Nov 28 07:25:44 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 439/1327] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 07:25:43 2023] DELETE /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 07:25:44 user devstack@n-api.service[64872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 07:25:44 user devstack@n-api.service[64872]: Tue Nov 28 07:25:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02 (ip 10.0.0.210) !!! Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_api:SELECT=2 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG dbcounter [-] [64872] Writing DB stats nova_cell1:SELECT=6 {{(pid=64872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [None req-e2db6665-dc1f-4354-a143-c707fd12420d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG nova.compute.api [None req-e2db6665-dc1f-4354-a143-c707fd12420d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64872) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e2db6665-dc1f-4354-a143-c707fd12420d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e2db6665-dc1f-4354-a143-c707fd12420d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e2db6665-dc1f-4354-a143-c707fd12420d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e2db6665-dc1f-4354-a143-c707fd12420d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e2db6665-dc1f-4354-a143-c707fd12420d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [None req-e2db6665-dc1f-4354-a143-c707fd12420d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:25:44 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:25:44 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=6 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:25:44 user devstack@n-api.service[64872]: DEBUG nova.policy [None req-e2db6665-dc1f-4354-a143-c707fd12420d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc8687cad2e4adb888c8f889e915ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68236ceaeff245b795f960f8c76dc912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64872) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 07:25:44 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [None req-e2db6665-dc1f-4354-a143-c707fd12420d tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02" status: 200 len: 1717 microversion: 2.1 time: 0.412677 Nov 28 07:25:44 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 447/1328] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:25:44 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02 => generated 1717 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 07:25:44 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539b0e5c-0f78-46aa-96fb-4b9953d3cd02", "name": "network-vif-unplugged", "status": "completed", "tag": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27"}]} {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:25:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:25:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:25:44 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:25:44 user devstack@n-api.service[64873]: INFO nova.api.openstack.compute.server_external_events [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] Creating event network-vif-unplugged:3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 on user Nov 28 07:25:44 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [req-2e864827-c9fd-4910-94fe-5f05dcf9a9ad req-6862aad5-c40f-4892-ab69-852973f1597d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160751 Nov 28 07:25:44 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 443/1329] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:25:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:25:45 user devstack@n-api.service[64871]: INFO oslo.messaging._drivers.impl_rabbit [-] [1ae8178a-5938-4e4b-aad4-0d28d1beb089] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 46600. Nov 28 07:25:45 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [req-f2aa62b6-de95-4d21-8657-cc528930b278 req-9e6e0c58-93ac-4919-97e2-ebd10b1d3dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539b0e5c-0f78-46aa-96fb-4b9953d3cd02", "name": "network-vif-deleted", "tag": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27"}]} {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:25:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f2aa62b6-de95-4d21-8657-cc528930b278 req-9e6e0c58-93ac-4919-97e2-ebd10b1d3dc0 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:25:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f2aa62b6-de95-4d21-8657-cc528930b278 req-9e6e0c58-93ac-4919-97e2-ebd10b1d3dc0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:25:45 user devstack@n-api.service[64871]: DEBUG oslo_concurrency.lockutils [req-f2aa62b6-de95-4d21-8657-cc528930b278 req-9e6e0c58-93ac-4919-97e2-ebd10b1d3dc0 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64871) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:25:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.compute.server_external_events [req-f2aa62b6-de95-4d21-8657-cc528930b278 req-9e6e0c58-93ac-4919-97e2-ebd10b1d3dc0 service nova] Creating event network-vif-deleted:3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 on user Nov 28 07:25:45 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [req-f2aa62b6-de95-4d21-8657-cc528930b278 req-9e6e0c58-93ac-4919-97e2-ebd10b1d3dc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136534 Nov 28 07:25:45 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 440/1330] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:25:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:25:46 user devstack@n-api.service[64872]: DEBUG nova.api.openstack.wsgi [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539b0e5c-0f78-46aa-96fb-4b9953d3cd02", "name": "network-vif-plugged", "status": "completed", "tag": "3ab39d3c-226f-4dc7-82d6-0a5c72305f27"}]} {{(pid=64872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 07:25:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:25:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:25:46 user devstack@n-api.service[64872]: DEBUG oslo_concurrency.lockutils [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64872) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:25:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.compute.server_external_events [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] Creating event network-vif-plugged:3ab39d3c-226f-4dc7-82d6-0a5c72305f27 for instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 on user Nov 28 07:25:46 user devstack@n-api.service[64872]: INFO nova.api.openstack.requestlog [req-cc29d68e-47f9-4f43-95a4-67800b050993 req-9f5af35a-0698-4ed4-b691-defc457c5499 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079449 Nov 28 07:25:46 user devstack@n-api.service[64872]: [pid: 64872|app: 0|req: 448/1331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 07:25:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_api:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG dbcounter [-] [64873] Writing DB stats nova_cell1:SELECT=2 {{(pid=64873) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '>' {{(pid=64873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG nova.compute.api [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] [instance: 539b0e5c-0f78-46aa-96fb-4b9953d3cd02] Fetching instance by UUID {{(pid=64873) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Acquiring lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG oslo_concurrency.lockutils [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Lock "27e7b418-6c10-4d08-8a14-ffd74894eb19" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64873) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 07:26:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.wsgi [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] HTTP exception thrown: Instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 could not be found. Nov 28 07:26:34 user devstack@n-api.service[64873]: DEBUG nova.api.openstack.wsgi [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Returning 404 to user: Instance 539b0e5c-0f78-46aa-96fb-4b9953d3cd02 could not be found. {{(pid=64873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 07:26:34 user devstack@n-api.service[64873]: INFO nova.api.openstack.requestlog [None req-0263c06e-38bc-4570-8bf1-1fc94ed78d3a tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02" status: 404 len: 111 microversion: 2.1 time: 0.034435 Nov 28 07:26:34 user devstack@n-api.service[64873]: [pid: 64873|app: 0|req: 444/1332] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 07:26:34 2023] GET /compute/v2.1/servers/539b0e5c-0f78-46aa-96fb-4b9953d3cd02 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 07:26:34 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:26:34 user devstack@n-api.service[64871]: DEBUG dbcounter [-] [64871] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64871) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 07:26:34 user devstack@n-api.service[64871]: DEBUG nova.api.openstack.wsgi [None req-e3f99a63-fdf3-44fe-a978-b9e83c0bfa38 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] Calling method '.version_select at 0x7f0b035f2440>' {{(pid=64871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 07:26:34 user devstack@n-api.service[64871]: INFO nova.api.openstack.requestlog [None req-e3f99a63-fdf3-44fe-a978-b9e83c0bfa38 tempest-SnapshotDataIntegrityTests-1003009732 tempest-SnapshotDataIntegrityTests-1003009732-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169283717" status: 202 len: 0 microversion: 2.1 time: 0.037034 Nov 28 07:26:34 user devstack@n-api.service[64871]: [pid: 64871|app: 0|req: 441/1333] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 07:26:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169283717 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)